Commit graph

10762 commits

Author SHA1 Message Date
Yen Chi Hsuan 9631a94fb5
[compat] Add compat_html_entities_html5
Used in tset_Vporn_1. Also Related to #9270
2016-06-10 15:05:24 +08:00
Yen Chi Hsuan cc4444662c [generic] Remove Vulture embed detection
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
2016-06-10 13:40:57 +08:00
Yen Chi Hsuan de3eb07ed6
[generic] Detect NBC News embeds 2016-06-10 13:32:59 +08:00
Yen Chi Hsuan 5de008e8c3
[nbcnews] Support embed widgets
Used in some Vulture videos
2016-06-10 13:31:55 +08:00
Yen Chi Hsuan 3e74b444e7
[vulture] Remove the extractor
The first 10 URLs in google search "site:http://video.vulture.com/video"
is dead. I guess Vulture does not host videos on their own anymore.
2016-06-10 13:13:59 +08:00
Yen Chi Hsuan e1e0a10c56
[weibo] Remove the extractor
The Weibo weishipin (微視頻, tiny videos) service is dead and now all
videos are hosted on Sina videos, which is covered by sina.py
2016-06-10 13:01:22 +08:00
Yen Chi Hsuan 436214baf7
[xfileshare] Skip an invalid test 2016-06-10 12:31:06 +08:00
Yen Chi Hsuan 506d0e9693
[xuite] Skip the invalid test 2016-06-10 12:29:58 +08:00
Yen Chi Hsuan 55290788d3 [yahoo] Yahoo doesn't like region names in lower cases
Fix test_Yahoo_7
2016-06-10 12:28:56 +08:00
Yen Chi Hsuan bc7e7adf51 [wdr] Subtitles are TTML 2016-06-10 00:22:41 +08:00
Sergey M․ b0aebe702c
[godtv] Relax _VALID_URL 2016-06-09 21:34:47 +07:00
Sergey M․ 416878f41f
[godtv] Add more tests 2016-06-09 21:33:51 +07:00
Sergey M․ c0fed3bda5
[godtv] Improve and add support for playlists (Closes #9608) 2016-06-09 21:29:41 +07:00
TRox1972 bb1e44cc8e
[godtv] Add extractor
[GodTV] Improvements
2016-06-09 21:27:27 +07:00
N1k145 21efee5f8b
[openload] Relax _VALID_URL
[openload] added to _TESTS, removed escape
2016-06-09 20:46:54 +07:00
Yen Chi Hsuan e2713d32f4
[openload] Fix extraction. Thanks @perron375 for the solution
Closes #9706
2016-06-09 19:00:13 +08:00
Yen Chi Hsuan e21c26daf9 Merge pull request #9395 from pmrowla/afreecatv
[afreecatv] Add new extractor for afreecatv.com VODs
2016-06-09 17:20:16 +08:00
Yen Chi Hsuan 1594a4932f
[wdr] Misc changes 2016-06-09 13:49:35 +08:00
Yen Chi Hsuan 6869d634c6
[wdr] Simplify extraction 2016-06-09 13:41:12 +08:00
Yen Chi Hsuan 50918c4ee0
[wdr] Support radio players (closes #6147) 2016-06-09 13:04:30 +08:00
Yen Chi Hsuan 6c33d24b46
[utils] Add audio/mpeg to mimetype2ext()
Used in WDR live radios (#6147)
2016-06-09 12:58:24 +08:00
Sergey M․ be6217b261
[YoutubeDL] Force string conversion on non string video ids 2016-06-09 05:34:19 +07:00
Sergey M․ 9d51a0a9a1
[vessel] Make hls formats non fatal 2016-06-09 04:13:38 +07:00
Sergey M․ 39da509f67
[vessel] Extract DASH formats 2016-06-09 04:12:48 +07:00
Sergey M․ a479b8f687
[vessel] Use native hls by default 2016-06-09 04:09:32 +07:00
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 2016-06-09 04:02:27 +07:00
Sergey M․ 11380753b5
[vessel] Add support for embed urls and improve extraction 2016-06-09 04:00:47 +07:00
Yen Chi Hsuan 411c590a1f
[youku:show] Add new extractor 2016-06-08 23:45:46 +08:00
Yen Chi Hsuan 6da8d7de69
[twitter] Update _TESTS 2016-06-08 21:48:12 +08:00
Yen Chi Hsuan c6308b3153
[twitter] Fix extraction for videos with HLS streams
Closes #9623
2016-06-08 21:28:10 +08:00
Yen Chi Hsuan fc0a45fa41
[twitter] Detect suspended accounts and update _TESTS 2016-06-08 21:12:14 +08:00
Yen Chi Hsuan e6e90515db
[nbc] Add the test case from #9578
Closes #9578
2016-06-08 20:50:01 +08:00
Yen Chi Hsuan 22a0a95247
[theplatform] Some NBC videos require an additional cookie
Related: #9578
2016-06-08 20:47:39 +08:00
Yen Chi Hsuan 50ce1c331c
[downloader/external] Add another env for proxies in ffmpeg/avconv
Related sources:
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/http.c;h=8fe8d11e1edfdbb04a8726db2c49cfef3f572aac;hb=HEAD#l152
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/tls.c;h=fab243e93e20034e88e619188c13a44a5d8ccdb9;hb=HEAD#l63
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/http.c#L191
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/tls.c#L92
2016-06-08 14:43:52 +08:00
Yen Chi Hsuan 7264e38591
[bilibili] Fix for videos without upload time (closes #9710) 2016-06-08 14:31:40 +08:00
Sergey M․ 33d9f3707c
[thesixtyone] Relax _VALID_URL (Closes #9714) 2016-06-08 02:22:04 +07:00
Sergey M․ a26a9d6239
[livestream:event] Ensure video id is string (Closes #9721) 2016-06-07 23:53:08 +07:00
Yen Chi Hsuan a4a8201c02
[wdr] Update _TESTS 2016-06-08 00:25:51 +08:00
Yen Chi Hsuan a6571f1073
[common] Fix <bootstrapInfo> detection in F4M manifests
Regression since 0a5685b26f
2016-06-08 00:19:33 +08:00
Sergey M․ 57b6e9652e
[canal+] Add support for d17.tv 2016-06-07 22:32:08 +07:00
Sergey M․ 3d9b3605a3
[canal+] Update tests 2016-06-07 22:26:18 +07:00
Sergey M․ 74193838f7
[canal+] Improve extraction (Closes #9718) 2016-06-07 22:12:20 +07:00
Sergey M fb94e260b5 Merge pull request #9720 from Kagami/vlive-new-statuses
[vlive] Acknowledge vlive+ streams statuses
2016-06-07 21:22:53 +07:00
Kagami Hiiragi 345dec937f [vlive] Acknowledge vlive+ streams statuses
Same as common statuses just with "PRODUCT_" prefix:
PRODUCE_LIVE_END, PRODUCT_COMING_SOON, etc.
2016-06-07 17:12:13 +03:00
Philipp Hagemeister 4315f74fa8 Merge remote-tracking branch 'Boris-de/wdrmaus_fix#8562' 2016-06-07 12:29:18 +02:00
Jaime Marquínez Ferrándiz e67f688025 [compat] Add 'compat_input' to __all__ 2016-06-05 23:16:08 +02:00
Sergey M․ 244fe977fe
[options] Add --load-info-json alias for symmetry with --write-info-json 2016-06-06 02:52:58 +07:00
Sergey M․ 7b0d1c2859
[__init__] Use write_string instead of compat_string (Closes #9689) 2016-06-05 21:01:20 +07:00
Sergey M․ 633b444fd2
[downloader/hls] Correct comment on twitch vods 2016-06-05 03:31:10 +07:00
Sergey M․ 51c4d85ce7
[downloader/hls] PEP 8 2016-06-05 03:21:43 +07:00
Sergey M․ 631d4c87ee
[twitch:vod] Use native hls 2016-06-05 03:19:44 +07:00
Sergey M․ 1e236d7e23
[downloader/hls] Do not rely on EXT-X-PLAYLIST-TYPE:EVENT 2016-06-05 03:16:05 +07:00
Sergey M․ 2c34735267
[youtube] Add itags 256 and 258 2016-06-05 01:44:13 +07:00
Sergey M․ 1ae6c83bce
[compat] Add compat_input 2016-06-05 00:43:55 +07:00
Sergey M․ 0fc832e1b2
[vidio] Improve (Closes #9562) 2016-06-04 16:48:24 +07:00
TRox1972 7def35712a
[vidio] Add extractor (Closes #7195)
[Vidio] fix fallback value and wrap duration in int_or_none

[Vidio] don't use video_id for _html_search_regex()
2016-06-04 16:48:24 +07:00
Sergey M․ 762d44c956
[channel9] Add support for rss links (Closes #9673) 2016-06-04 04:57:16 +07:00
Sergey M․ 4d8856d511
[loc] Extract direct download links 2016-06-04 00:26:03 +07:00
Sergey M․ c917106be4
[loc] Extract subtites 2016-06-03 23:55:22 +07:00
Sergey M․ 76e9cd7f24
[loc] Add support for another URL schema and simplify 2016-06-03 23:43:34 +07:00
Sergey M․ bf4c6a38e1 release 2016.06.03 2016-06-03 23:25:24 +07:00
Sergey M․ 7f3c3dfa52
[loc] Improve (Closes #9521) 2016-06-03 23:19:11 +07:00
TRox1972 9c3c447eb3
[loc] Add extractor (Closes #3188)
Added extractor of loc.gov, which closes #3188. I am not an experienced programmer, so I am sure I did a bunch of mistakes, but the extractor works (for me at least).

[LibraryOfCongress] don't use video_id for _search_regex()

[LibraryOfCongress] Improvements
2016-06-03 22:17:35 +07:00
Yen Chi Hsuan ad73083ff0
[bilibili] Add _part%d suffixes back (closes #9660) 2016-06-02 19:29:27 +08:00
bzc6p c88270271e Added sanitization support for Hungarian letters Ő and Ű 2016-06-02 11:51:48 +02:00
Yen Chi Hsuan 9a4aec8b7e [utils] Use bytes-like objects as header values on Python 2 2016-06-02 15:00:49 +08:00
Yen Chi Hsuan 0ea590076f [utils] Always decode Location header
escape_url is broken for bytes-like objects
2016-06-02 15:00:49 +08:00
Remita Amine 4a684895c0 [seeker] Add new extractor(closes #9619) 2016-06-01 21:20:25 +01:00
Remita Amine f4e4aa9b6b [revision3:embed] Add new extractor 2016-06-01 21:20:25 +01:00
Sergey M․ 5e3856a2c5 release 2016.06.02 2016-06-02 01:19:57 +07:00
Sergey M․ 6e6b9f600f
[arte] Add support for playlists and rework tests (Closes #9632) 2016-06-02 01:10:23 +07:00
Sergey M․ 6a1df4fb5f
[spankwire] Add support for new URL format (Closes #9657) 2016-06-01 21:23:58 +07:00
Yen Chi Hsuan dde1ce7c06
[tf1] Fix a regular expression (closes #9656)
This is a Python bug fixed in 2.7.6 [1]

[1] https://github.com/rg3/youtube-dl/issues/9656#issuecomment-222968594
2016-06-01 20:04:43 +08:00
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 2016-06-01 19:23:44 +08:00
Yen Chi Hsuan 0ff3749bfe
[udn] Fix m3u8 and f4m extraction as well as improve 2016-06-01 19:23:09 +08:00
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 2016-06-01 19:18:01 +08:00
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
2016-06-01 18:37:34 +08:00
Peter Rowlands e7d85c4ef7 use /track/video/file to determine if video exists 2016-05-31 17:28:49 +09:00
Sergey M․ 8ec2b2c41c
[options] Add --limit-rate alias for rate limiting option
Closes #9644
In order to follow regular --verb-noun pattern and better conformity with wget and curl
2016-05-30 21:48:35 +07:00
Sergey M․ 197a5da1d0
[yandexmusic] Improve captcha detection 2016-05-30 03:26:26 +07:00
Sergey M․ abbb2938fa release 2016.05.30.2 2016-05-30 03:12:12 +07:00
Sergey M․ f657b1a5f2 release 2016.05.30.1 2016-05-30 03:03:06 +07:00
Sergey M․ 8267423652 release 2016.05.30 2016-05-30 01:18:23 +07:00
Yen Chi Hsuan 9ed6d8c6c5
[youku] Extract resolution 2016-05-29 13:54:05 +08:00
Yen Chi Hsuan 6461f2b7ec
[bilibili] Fix extraction, improve and cleanup 2016-05-29 01:26:00 +08:00
Sergey M․ 807cf7b07f
[udemy] Fix authentication for localized layout (Closes #9594) 2016-05-28 21:18:24 +06:00
Sergey M․ de7d76af52
[coub] Add another test 2016-05-27 23:38:17 +06:00
Sergey M․ 11c70deba7
[coub] Add extractor (Closes #9609) 2016-05-27 23:34:58 +06:00
Sergey M․ f36532404d
[vk] Remove superfluous code 2016-05-27 22:19:10 +06:00
Sergey M․ 77b8b4e696
[extractor/common] Borrow quality metadata from parent set-level manifest for f4m 2016-05-27 01:47:44 +06:00
Sergey M․ 2615fa7584
[downloader/f4m] Simply select format when it's the only one 2016-05-27 01:46:12 +06:00
Boris Wachtmeister 3a686853e1 [WDR] fixed parsing of playlists 2016-05-26 20:54:51 +02:00
Boris Wachtmeister 949fc42e00 [WDR] the other wdrmaus.de pages also changed to the new player 2016-05-26 20:54:51 +02:00
Boris Wachtmeister 33a1ff7113 [WDR] extract jsonp-url by parsing data-extension of mediaLink 2016-05-26 20:54:51 +02:00
Boris Wachtmeister bec2c14f2c [WDR] add special handling if alt-url is a m3u8 2016-05-26 20:54:51 +02:00
Boris Wachtmeister 37f972954d [WDR] use _download_json with a strip_jsonp 2016-05-26 20:54:51 +02:00
Boris Wachtmeister 3874e6ea66 [WDR] use single quotes for strings 2016-05-26 20:54:51 +02:00
Yen Chi Hsuan fac2af3c51
[common] Fix m3u8 extraction in f4m manifests 2016-05-27 01:41:27 +08:00
Sergey M․ 6f8cb24219
[tvp] Expand _VALID_URL and improve naming (Closes #9602) 2016-05-26 22:21:55 +06:00
Yen Chi Hsuan 448bb5f333
[common] Fix non-bootstrapped support in f4m 2016-05-27 00:03:48 +08:00