e3ea479087
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374 )
...
They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable.
Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 16:24:24 +02:00
faab1d3836
[youtube] Fix detection of feeds urls ( fixes #1294 )
...
Urls like https://www.youtube.com/feed/watch_later were being as users (before the last changes to YoutubeUserIE, as videos)
2013-09-06 14:45:49 +02:00
f4b052321b
[youtube] Urls like youtube.com/NASA are now interpreted as users ( fixes #1069 )
...
Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-05 22:39:15 +02:00
b7052e5087
Also print the field that fails if it is a md5 checksum
2013-08-29 12:15:45 +02:00
aa6a10c44a
Allow to specify multiple subtitles languages separated by commas ( closes #518 )
2013-08-23 18:34:57 +02:00
9e9c164052
Merge pull request #937 from jaimeMF/subtitles_rework
...
Subtitles rework
2013-08-23 02:40:25 -07:00
18b4e04f1c
Merge branch 'master' into subtitles_rework
2013-08-22 23:29:36 +02:00
d741e55a42
[youtube] Support watch_popup URLs ( Fixes #1275 )
2013-08-19 10:27:42 +02:00
d80a064eff
[subtitles] Added tests to check correct behavior when no subtitles are
...
available
2013-08-08 22:22:33 +02:00
447591e1ae
[test] Cleaned subtitles tests
2013-08-08 11:03:52 +02:00
33eb0ce4c4
[subtitles] removed only-sub option (--skip-download achieves the same
...
functionality)
2013-08-08 10:06:24 +02:00
e2f48f9643
Remove youtube sig tests
...
The signature algo changes too often for the static test to make sense.
2013-08-07 20:11:40 +02:00
953e32b2c1
[dailymotion] Added support for subtitles + new InfoExtractor for
...
generic subtitle download.
The idea is that all subtitle downloaders must descend from SubtitlesIE
and implement only three basic methods to achieve the complete subtitle
download functionality. This will allow to reduce the code in YoutubeIE
once it is rewritten.
2013-08-07 18:59:11 +02:00
04bca64bde
[youtube]: new algo for length 83 ( fixes #1164 )
2013-08-02 12:38:17 +02:00
75952c6e3d
YoutubeIE: new algo for length 86 ( fixes #1156 )
...
Now is using the same length as the flash player used for age protected videos, but the algorithm is different, so now for age protected videos it first tries to use the old algo.
2013-07-31 10:45:13 +02:00
caeefc29eb
[vimeo] add an extractor for channels
2013-07-29 13:12:09 +02:00
a3c736def2
[dailymotion] Add an extractor for Dailymotion playlists
2013-07-29 12:07:38 +02:00
5c468ca8a8
YoutubeIE: add algo for length 79 ( fixes #1126 )
2013-07-25 22:50:24 +02:00
aedd6bb97d
YoutubeIE: new algo for length 81 ( fixes #1127 )
2013-07-25 22:06:53 +02:00
239e3e0cca
YoutubeIE: new algo for length 87 ( fixes #1105 )
...
Squashed commit from the pull requests #1107 , #1109 and #1110 .
2013-07-24 10:20:52 +02:00
5d51a883c2
Use a dictionary for storing the subtitles
...
The errors while getting the subtitles are reported as warnings, if no subtitles are found return and empty dict.
2013-07-20 12:52:25 +02:00
a4358cbabd
YoutubeIE: new algo for length 85 ( closes #1080 ), thanks to @patrickslin
2013-07-19 17:12:40 +02:00
3e0b3a1428
Remove the test to signature of lengths 43,43
...
It's already covered by the test for length 87
2013-07-18 12:29:09 +02:00
444b116597
YoutubeIE: add algo for length 90 ( closes #1064 )
...
Order the cases from higher to lower length.
2013-07-18 12:25:41 +02:00
51fb64bab1
Mark test_youtube_sig as non-executable ( #1066 )
2013-07-17 11:04:07 +02:00
2a5201638d
[youtube] Add sig test for 92 (Thanks to @patrickslin)
2013-07-17 09:23:38 +02:00
606d7e67fd
YoutubeIE: add algo for length 81 ( closes #1026 )
2013-07-11 23:47:54 +02:00
85347e1cb6
YoutubeIE: a new algo for length 83
2013-07-11 20:21:45 +02:00
59ae56fad5
Add helper function find_path_attr
2013-07-11 16:12:08 +02:00
c93898dae9
YoutubeIE: new algo for length 83 ( closes #1017 and closes #1016 )
2013-07-10 10:44:04 +02:00
897f36d179
[youtube:subscriptions] Use colon for differentiation of shortcuts
2013-07-07 17:13:26 +02:00
75dff0eef7
[youtube]: add YoutubeShowIE ( closes #14 )
...
It just extracts the playlists urls for each season
2013-07-01 17:59:28 +02:00
bc2884afc1
Print which IE is being skipped in test_download
2013-06-28 11:20:00 +02:00
023fa8c440
Add function add_default_info_extractors to YoutubeDL
...
It adds to the list the ies returned by ge_extractors
2013-06-27 23:51:06 +02:00
a924876fed
Make sure that IEs only accept their own URLs
2013-06-27 21:25:51 +02:00
fc2c063e1e
Move testcase generator to helper
2013-06-27 21:15:16 +02:00
6f5ac90cf3
Move tests to the IE definitions
2013-06-27 20:46:46 +02:00
0c56a3f773
[googleplus] move tests
2013-06-27 20:31:27 +02:00
9d069c4778
[infoq] move tests
2013-06-27 20:27:08 +02:00
67f51b3d8c
[youku] move tests
2013-06-27 20:25:46 +02:00
5c5de1c79a
[eighttracks] move test
2013-06-27 20:22:00 +02:00
0821771466
[steam] move test
2013-06-27 20:20:00 +02:00
83f6f68e79
[metacafe] move tests
2013-06-27 20:18:35 +02:00
0c6c096c20
[soundcloud] Move tests
2013-06-27 20:17:21 +02:00
41beccbab0
Use str every time
2013-06-27 19:43:43 +02:00
2eb88d953f
Allow _TESTS attribute for IEs with multiple tests
...
This also improves the numbering of duplicate tests
2013-06-27 19:13:11 +02:00
6b47c7f24e
Allow moving tests into IE files
...
Allow adding download tests right in the IE file.
This will cut down on merge conflicts and make it more likely that new IE authors will add tests right away.
2013-06-27 18:28:45 +02:00
ed4a915e08
Add tests and improve for HotNewHipHop
2013-06-27 17:56:48 +02:00
23300d7149
a new day, a new s algo - fix #946
2013-06-27 12:24:46 +02:00
6b37f0be55
Add a clean-room implementation for youtube signatures
2013-06-27 01:51:10 +02:00
5746f9da99
Add test for youtube signature algorithm
2013-06-27 00:09:25 +02:00
112da0a0ce
Simplify FakeYDL
2013-06-27 00:09:05 +02:00
ed92bc9f6e
[wimp] minor readability improvements ( #940 )
2013-06-26 18:22:42 +02:00
aa0c87391c
Add CSpanIE ( closes #312 )
2013-06-26 17:55:54 +02:00
8bcc355972
removed trailing ',' and corrected the title in test
2013-06-26 15:51:25 +05:00
6b4642fae3
added test for wimp.com
2013-06-26 15:40:24 +05:00
65cceef8f4
Added support for additional vtt subtitle format (WebVTT) in youtube-dl.
2013-06-26 11:28:47 +02:00
b004821fa9
Add the option "--write-auto-sub" to download automatic subtitles from Youtube
...
Now automatic subtitles are only downloaded if the option is given.
(closes #903 )
2013-06-25 23:46:24 +02:00
f4daa18152
added test for tudou.com
2013-06-25 22:52:21 +05:00
f7ab6cbe16
add tests for use_cipher_signature videos ( #897 ) and the ability to test multiple videos per IE
2013-06-25 14:38:00 +02:00
70d1924f8b
Add VevoIE
2013-06-24 12:31:41 +02:00
8bf8b5a577
Use the new class in the tests
2013-06-24 10:21:44 +02:00
8222d8de88
Split FileDownloader in two classes: FileDownloader and YoutubeDL
...
YoutubeDL is the class that coordinates everything
FileDownloader gets a filename and an info dict and downloads the video.
2013-06-24 10:21:43 +02:00
825e0984e2
[break] adapt to new paths
2013-06-23 22:59:51 +02:00
d1cade5ade
Correct module name
2013-06-23 22:53:42 +02:00
0824c28c8b
Remove mentions of old InfoExtractors module
2013-06-23 22:42:59 +02:00
b8a360837a
Fix Statigram test
2013-06-23 21:34:40 +02:00
51ce3a75c9
Improve error reporting for downloads
2013-06-23 21:33:11 +02:00
9b5fffb149
added an IE and test for break.com
2013-06-23 22:42:51 +05:00
828dba2983
Improvge error reporting
2013-06-23 18:59:01 +02:00
6b3f5a329b
Improve Statigr.am IE
2013-06-23 18:58:53 +02:00
4fdd4e6f6f
added test for Statigr
2013-06-23 18:56:26 +05:00
f4c8bbcfc2
TEDIE: download the best quality video and use the new _search_regex functions
...
Also extracts the description.
2013-06-20 20:51:20 +02:00
377fdf5dde
Update the TumblrIE: the video is no longer available
2013-06-20 14:02:21 +02:00
213b715893
Merge pull request #887 from anisse/master
...
Fetch all entries that are in a youtube playlist
Also add a test.
2013-06-19 12:52:44 +02:00
8bc7c3d858
Merge branch 'search_regex' - PR #872 - closes #847
2013-06-17 19:28:18 +02:00
36ed7177f0
Fix HypemIE test: the song name has been changed
2013-06-16 20:42:28 +02:00
32aa88bcae
Add GametrailersIE
2013-06-16 20:34:45 +02:00
31513ea6b9
Update test_issue_673 in Youtube Lists
...
Some videos have been removed.
Delete the title check, it's not the purpose of that test.
2013-06-15 11:20:22 +02:00
9abc6c8b31
Update YahooIE test
...
The old test video is no longer available.
2013-06-10 19:42:02 +02:00
ee55fcbe12
switch long info_dict fields checking to md5
2013-06-09 15:03:54 +02:00
78d3442b12
test: extend the reach of info_dict checking
...
* print the info_dict in a format suitable to easy adding to tests.json during tests if un-tested fields are detected
* make it possible to put the crc32 in tests.json if the field is too long
* complete the "info_dict" fields in existing tests
* fixed the bugs catched doing this
2013-06-09 14:21:42 +02:00
979a9dd4c4
_html_search_regex with clean_html superpowers
2013-06-09 11:57:13 +02:00
ecb3e676a5
Added Vbox7 Infoextractor
2013-06-08 12:44:38 +05:00
be95cac157
raise exceptions on warnings during tests - and solve a couple of them
2013-06-07 12:46:23 +02:00
476203d025
print WARNINGs during test + minor fix to NBAIE
2013-06-06 15:07:05 +02:00
157b864a01
added HypemIE
...
rebased, closes PR #871
2013-06-06 12:01:07 +02:00
951b9dfd94
Merge pull request #866 from yasoob/master
...
Added support for XHamster - closes #841
2013-06-04 10:39:31 -07:00
c978a96c02
Added test for XHamster.com
2013-06-04 17:33:02 +05:00
57bde0d9c7
Fix the test_all_urls (Import issue)
2013-06-04 13:10:12 +02:00
50b4d25980
Merge within test_all_urls
2013-06-04 13:06:49 +02:00
4a76d1dbe5
Add tests for justin.tv and twitch.tv
2013-06-03 22:16:55 +02:00
dc1c355b72
YoutubeIE: fallback to automatic captions when subtitles aren't found ( closes #843 )
...
Also modify test_youtube_subtitles to support running the tests in any order.
2013-05-31 17:03:40 +02:00
45014296be
Add TeamcocoIE ( closes #212 )
2013-05-21 14:37:32 +02:00
afef36c950
add support for Flickr videos - closes #261
2013-05-20 23:19:38 +02:00
17bd1b2f41
VineIE: extract more information and minor style changes
2013-05-20 08:31:03 +02:00
5b0d3cc0cd
Add support for Vine - closes #845
2013-05-20 00:33:14 +02:00
d4f76f1674
Add support for Howcast.com - closes #835
2013-05-18 19:17:19 +02:00
340fa21198
UstreamIE: get thumbnail and uploader name
2013-05-18 11:54:18 +02:00
59f4fd4dc6
YahooIE: remove old code and accept screen.yahoo.com videos ( #300 )
...
Videos require rtmpdump
2013-05-12 14:05:14 +02:00
86fd453ea8
Merge remote-tracking branch 'origin/master'
2013-05-10 09:21:24 +02:00
c83411b9ee
Skip bandcamp tests for now - free limit has been exceeded
2013-05-10 09:10:34 +02:00
057c9938a1
Import FileDownloader in test_youtube_subtitles
...
Fix last commit
2013-05-10 08:37:49 +02:00
9259966132
test_youtube_subtitles: FakeDownloader inherits form FileDownloader
2013-05-10 08:31:30 +02:00
7f5bd09baf
Add support to www.ina.fr
2013-05-05 20:54:36 +02:00
d96680f58d
PhotobucketIE: accept new format of urls and add a test
2013-05-05 13:07:00 +02:00
09dd418f53
Experimentally whitelist Escapist test
2013-05-04 09:11:38 +02:00
c34407d16c
Simplify RedTube
2013-05-03 20:07:35 +02:00
815dd2ffa8
Redtube test now works
...
I just did a little makeover by changing redtube tests. Now they are passed.
2013-05-03 23:51:27 +06:00
b86174e7a3
added test for redtube.com
...
I just added the test for redtube.com
2013-05-03 22:40:56 +06:00
46bfb42258
InfoExtractors: use _download_webpage in more IEs
...
IEs without tests are intact.
2013-05-02 18:18:27 +02:00
104ccdb8b4
TumblrIE: fix title matching
2013-05-02 13:12:41 +02:00
aed523ecc1
Add BandcampIE ( closes #568 )
2013-05-01 15:55:46 +02:00
34c29ba1d7
Add test for SoundcloudSet
2013-04-30 21:23:38 +02:00
8749b71273
Fix FakeDownloaders
2013-04-30 19:42:13 +02:00
ba7c775a04
Remove a commented line I forgot.
...
[ci skip]
2013-04-30 14:21:46 +02:00
9665577802
Adapt tests to changes in youtube's "Most Popular" channel
2013-04-28 15:50:29 +02:00
37254abc36
Allow to use relative dates in the format (now|today)[+-][0-9](day|week|month|year)(s)? ( Closes #137 )
...
Also fix DateRange not accepting ranges of one day.
2013-04-28 11:39:37 +02:00
bf50b0383e
Fix some IEs that didn't return the uploade_date in the YYYYMMDD format
...
Create a function unified_strdate in utils.py to fix these problems
2013-04-27 15:14:20 +02:00
bd55852517
Allow to select videos to download by their upload dates (related #137 )
...
Only absolute dates.
2013-04-27 14:01:55 +02:00
aba8df23ed
YoutubePlaylistIE: don't crash with empty lists (related #808 )
...
The playlist_title wasn't initialized.
2013-04-27 10:41:52 +02:00
c15e024141
TumblrIE
...
I haven't found many videos to test, so it may not work for all.
2013-04-22 21:27:27 +02:00
c72938240e
Get the title of Youtube playlists
2013-04-20 18:57:05 +02:00
9341212642
Create a function in InfoExtractors that returns the InfoExtractor class with the given name
2013-04-20 12:42:57 +02:00
49da66e459
The test video for subtitles has added a new language
2013-04-20 10:39:02 +02:00
fb6c319904
Add tests for YoutubeChannelIE
...
- tests for identifying channel urls
- test retrieval of paginated channel
- test retrieval of autogenerated channel
2013-04-19 18:11:05 -04:00
dce9027045
Merge branch 'extract_info_rewrite'
2013-04-19 21:57:08 +02:00
744435f2a4
Show whole diff in error cases
2013-04-11 18:38:43 +02:00
0ba994e9e3
Skip ARD test as it requires rtmpdump
2013-04-11 17:20:17 +02:00
af9ad45cd4
Re-enable Stanford OC test
2013-04-11 17:20:05 +02:00
b03d65c237
Minor improvements for ARD IE
2013-04-11 10:47:21 +02:00
14294236bf
Merge branch 'master' into extract_info_rewrite
2013-04-05 12:39:51 +02:00
90a99c1b5e
retry on UnavailableVideoError
2013-03-31 03:29:34 +02:00
f375d4b7de
import all IEs when testing to resemble more closely the real env
2013-03-31 03:12:28 +02:00
e3700fc9e4
Merge pull request #736 from rg3/retry
...
Exception stacking and test retry
2013-03-29 09:01:27 -07:00
46b9d8295d
Merge pull request #730 by @JohnyMoSwag
...
Support for Worldstarhiphop.com
2013-03-29 16:14:49 +01:00
0cd358676c
Rebased, fixed and extended LiveLeak.com support
...
close #757 - close #761
2013-03-29 15:13:24 +01:00
44e939514e
Added test for WorldStarHipHop
2013-03-28 20:05:28 -07:00
cfa90f4adc
Merge branch 'master' into extract_info_rewrite
2013-03-28 13:20:33 +01:00
5cb3c0b319
Merge pull request #699 by @iemejia
...
Removed innecesary function to convert subtitles, improved use of the youtube api
2013-03-20 11:35:55 +01:00
2a4093eaf3
Added new option '--list-subs' to show the available subtitle languages
2013-03-20 08:41:54 +01:00
9e62bc4439
Added new option '--sub-format' to choose the format of the subtitles to downloade (defaut=srt)
2013-03-20 08:41:54 +01:00
ae608b8076
Added new option '--all-srt' to download all the subtitles of a video.
...
Only works in youtube for the moment.
2013-03-20 08:41:53 +01:00
e32b06e977
Spiegel IE
2013-03-12 01:08:54 +01:00
8cc83b8dbe
Bubble up all the stack of exceptions and retry download tests on timeout errors
2013-03-09 10:05:43 +01:00
3d3423574d
Fix Unicode handling GenericIE ( Fixes #734 )
2013-03-08 20:47:06 +01:00
8a38a194fb
Add auxiliary methods to InfoExtractor to set the '_type' key and use them for some playlist IEs
2013-03-05 20:55:48 +01:00
597cc8a455
Use extract_info in YoutubePlaylist and YoutubeSearch
2013-03-05 11:58:01 +01:00
a2ae43a55f
Remove changed playlist test ( #661 )
2013-03-03 22:19:19 +01:00
7ae153ee9c
Remove tweetreel - it has shut down
2013-03-03 22:15:06 +01:00
Jaime Marquínez Ferrándiz