Commit graph

13835 commits

Author SHA1 Message Date
Yen Chi Hsuan 3869028ffb [utils] Use bytes-like objects in dfxp2srt
This fixes handling of non-UTF8 TTML subtitles

Closes #14191
2017-09-16 12:18:38 +08:00
Yen Chi Hsuan a88d461dff Merge pull request #14225 from Tithen-Firion/openload-phantomjs-method
Openload phantomjs method
2017-09-16 02:28:28 +08:00
Sergey M․ a4245acef8
[noovo] Fix extraction (closes #14214) 2017-09-15 23:12:19 +07:00
Sergey M․ 6be44a50ed
[dailymotion:playlist] Relax _VALID_URL (closes #14219) 2017-09-15 22:25:38 +07:00
Sergey M․ b763e1d68c
[twitch] Add support for go.twitch.tv URLs (closes #14215) 2017-09-15 22:18:38 +07:00
Sergey M․ cbf85239bb
[vgtv] Relax _VALID_URL (closes #14223) 2017-09-15 22:13:30 +07:00
Sergey M․ 159d304a9f
release 2017.09.15 2017-09-15 21:48:06 +07:00
Sergey M․ c46680fb2a
[condenast] Fix extraction (closes #14196, closes #14207) 2017-09-15 02:01:17 +07:00
Philipp Hagemeister fad9fc537d [tv4] fix a test URL 2017-09-14 20:47:23 +02:00
Philipp Hagemeister 0732a90579 [orf] Add new extractor for f4m stories 2017-09-14 20:37:46 +02:00
Sergey M․ 319fc70676
[tv4] Relax _VALID_URL (closes #14206) 2017-09-14 23:50:19 +07:00
Sergey M․ e7c3e33456
[downloader/fragment] Restart inconsistent incomplete fragment downloads (#13731) 2017-09-14 23:19:53 +07:00
Yen Chi Hsuan 757984af90 Merge pull request #12909 from remitamine/raw-sub
[YoutubeDL] write raw subtitle files
2017-09-13 17:36:40 +08:00
Sergey M․ 2f483758bc
[animeondemand] Improve and modernize 2017-09-11 04:32:35 +07:00
Sergey M․ 018cc61549
[animeondemand] Bypass geo restriction 2017-09-11 04:23:42 +07:00
Sergey M․ 2709d9fa28
[animeondemand] Add support for flash videos (closes #9944) 2017-09-11 04:23:42 +07:00
Sergey M․ 7dacceae75
release 2017.09.11 2017-09-11 03:30:33 +07:00
Sergey M․ f12a6e88b2
[rutube:playlist] Fix suitable (closes #14166) 2017-09-11 03:23:00 +07:00
Sergey M․ 806498cf2f
release 2017.09.10 2017-09-10 22:16:55 +07:00
Sergey M․ bf6ec2fea9
[fox] Fix extraction (#14147) 2017-09-10 22:08:32 +07:00
Sergey M․ c3dd44e085
[rutube] Use bool_or_none 2017-09-10 19:09:27 +07:00
Sergey M․ c7e327c4d4
[utils] Introduce bool_or_none 2017-09-10 19:08:39 +07:00
Sergey M․ 48b813748d
[rutube] Rework and generalize playlist extractors (closes #13565) 2017-09-10 18:40:33 +07:00
luceatnobis debed8d759
[rutube:playlist] Add extractor (closes #13534) 2017-09-10 18:40:33 +07:00
Olivier Bilodeau 931edb2ada [radiocanada] Add fallback for title extraction 2017-09-08 21:53:24 +07:00
Sergey M․ 5113b69124
[abcnews,chilloutsoze,cracked,vice,vk] Use dedicated YouTube embeds extraction routines 2017-09-06 00:50:25 +07:00
Sergey M․ 66c9fa36c1
[youtube] Separate methods for embeds extraction 2017-09-06 00:48:37 +07:00
Sergey M․ c5c9bf0c12
[YoutubeDL] Ensure dir existence for each requested format (closes #14116) 2017-09-05 23:31:34 +07:00
Sergey M․ 880fa66f4f
[redtube] Fix formats extraction (closes #14122) 2017-09-05 22:45:49 +07:00
Sergey M․ 6348671c4a
[arte] Relax unavailability check (closes #14112) 2017-09-04 23:08:40 +07:00
Sergey M․ efc57145c1
[manyvids] Improve (closes #14059) 2017-09-03 17:32:23 +07:00
John D e9b865267a
[manyvids] Add support for preview videos (closes #14053) 2017-09-03 17:31:53 +07:00
Sergey M․ bc35f07537
[vidme:user] Make tests only matching (closes #14054) 2017-09-03 17:03:51 +07:00
theychx 0b4a8eb3ac
[vidme:user] Relax _VALID_URLs 2017-09-03 17:03:45 +07:00
Sergey M․ c1c1585b31
[bpb] Improve (closes #14086) 2017-09-03 16:43:33 +07:00
Timendum 0cbb841ba9
[bpb] Fix extraction (closes #14043) 2017-09-03 16:39:12 +07:00
Sergey M d7c7100e3d
[soundcloud] Simplify and add test (closes #14093) 2017-09-03 16:29:58 +07:00
Tatsuyuki Ishi 73602bcd0c
[soundcloud] Fix download URL with private tracks 2017-09-03 16:28:34 +07:00
Sergey M․ 23b2df82c7
[aliexpress:live] Fix issues (closes #13698, closes #13707) 2017-09-03 16:05:31 +07:00
dubber0 503115540d
[aliexpress:live] Add extractor 2017-09-03 16:05:00 +07:00
Sergey M․ 64f0e30b93
[viidea] Capture and output lecture error message (#14099) 2017-09-02 15:44:49 +07:00
Sergey M․ a3431e1224
[radiocanada] Skip unsupported platforms (closes #14100) 2017-09-02 15:33:54 +07:00
Sergey M․ a2022b0c40
release 2017.09.02 2017-09-02 01:08:32 +07:00
Sergey M․ 8d81f3e36d
[youtube] Force old layout for each webpage (closes #14083) 2017-09-02 00:58:19 +07:00
Sergey M․ 7998520933
[youtube] Fix upload date extraction (closes #14065) 2017-08-31 00:47:58 +07:00
Sergey M․ 5b4bfbfc3b
[charlierose] Add support for episodes (closes #14062) 2017-08-30 23:50:33 +07:00
Sergey M․ 53647dfd0a
[bbccouk] Add support for w-prefixed ids (closes #14056) 2017-08-30 05:27:56 +07:00
Sergey M․ 1b41da488d
[googledrive] Extend _VALID_URL (closes #9785) 2017-08-28 00:50:41 +07:00
Sergey M․ fea82c1780
[googledrive] Add support for source format (closes #14046) 2017-08-28 00:39:22 +07:00
Sergey M․ 3902cdd0e3
[pornhd] Fix extraction (closes #14005) 2017-08-27 22:37:26 +07:00
Sergey M․ 2cfa7cbdd0
release 2017.08.27.1 2017-08-27 06:09:29 +07:00
Sergey M․ 1c9c8de29e
[youtube] Fix extraction with --youtube-skip-dash-manifest enabled (closes #14037) 2017-08-27 06:06:39 +07:00
Sergey M․ f031b76065
release 2017.08.27 2017-08-27 04:28:04 +07:00
Sergey M․ ff17be3ac9
[extractor/generic] Extract from LD-JSON last of all
Previous sources may contain several formats, e.g. http://tamasha.com/v/PgGZ
2017-08-27 03:31:40 +07:00
Sergey M․ 1ed4549942
[extractor/common] Extract format id from label attribute of source tag for HTML5 videos (#14034) 2017-08-27 03:27:05 +07:00
Sergey M․ dd121cc1ca
[extractor/common] Extract height from res attribute of source tag for HTML5 videos (closes #14034) 2017-08-27 03:12:56 +07:00
Sergey M․ a3c3a1e128
[http] Rework HTTP downloader
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes #506, closes #809, closes #2849, closes #4240, closes #6023, closes #8625, closes #9483
2017-08-27 02:22:30 +07:00
Sergey M․ 085d9dd9be
[rai] Fix audio formats extraction (closes #14024) 2017-08-26 22:02:49 +07:00
Vijay Singh 151978f38a [mixcloud] Fix extraction (closes #14020) 2017-08-26 19:32:57 +07:00
Sergey M․ c7121fa7b8
[youtube] Fix controversy videos extraction (closes #14027, closes #14029) 2017-08-26 15:38:38 +07:00
Vijay Singh 745968bc72 [mixcloud] Fix extraction (closes #14015) 2017-08-24 22:28:44 +07:00
Sergey M․ df235dbba8
release 2017.08.23 2017-08-23 23:23:13 +07:00
Sergey M․ 5bae33485c
[toutv] PEP 8 2017-08-23 22:50:00 +07:00
Sergey M․ 0830f3e048
[cbc:watch] Bypass geo-restriction (closes #13993) 2017-08-23 22:45:45 +07:00
Sergey M․ 8d7a24aff6
[toutv] Relax DRM check (closes #13994) 2017-08-23 22:28:09 +07:00
Sergey M․ 37d9af306a
[googledrive] Simplify and carry long lines (#13638) 2017-08-23 00:33:53 +07:00
Sergey M․ e01c3d2ef7
[extractor/common] Introduce _parse_xml 2017-08-23 00:32:41 +07:00
Parmjit Virk 05915e379a [googledrive] Add support for subtitles (fixes #13619) 2017-08-22 23:48:59 +07:00
Sergey M․ 8d9c2a681a
[pornhub] Relax uploader regex (closes #13906, closes #13975) 2017-08-21 23:06:27 +07:00
Luca Steeb 8239c6791a [bandcamp:album] Extract track titles 2017-08-20 23:32:33 +07:00
Sergey M․ b359e977b9
[extractor/common] Make HLS and DASH extraction non fatal in _parse_html5_media_entries (closes #13970) 2017-08-20 14:16:58 +07:00
Sergey M․ d3d45e0a45
[bbccouk] Add support for events URLs (closes #13893) 2017-08-19 23:54:15 +07:00
Yen Chi Hsuan 381ad4f309
[liveleak] Support multi-video pages (closes #6542) 2017-08-19 22:48:00 +08:00
Yen Chi Hsuan 09747ba766
[liveleak] Support another liveleak embedding pattern (closes #13336) 2017-08-19 22:28:13 +08:00
Yen Chi Hsuan f8f18f332f
[cda] Fix extraction (closes #13935) 2017-08-19 21:44:47 +08:00
Yen Chi Hsuan 95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a"" (#13935) 2017-08-19 21:40:53 +08:00
Sergey M․ f5469da9e6
[laola1tv] Add support for tv.ittf.com (closes #13965) 2017-08-19 19:48:20 +07:00
Sergey M․ d14d9d8903
[mixcloud] Fix extraction (closes #13958) 2017-08-18 23:31:42 +07:00
Sergey M․ ea004d34f8
release 2017.08.18 2017-08-18 01:05:27 +07:00
Sergey M․ 4a91910365
[qqmusic:toplist] PEP 8 2017-08-18 01:00:07 +07:00
Sergey M․ c0892b2b46
[arte] Detect unavailable videos (closes #13945) 2017-08-18 00:58:23 +07:00
Sergey M․ a5ac0c4755
[YoutubeDL] Sanitize byte string format URLs (#13951) 2017-08-17 23:59:12 +07:00
Sergey M․ 5551d7714d
[generic] Convert redirect URLs to unicode strings (closes #13951) 2017-08-17 23:58:01 +07:00
Sergey M․ 5f5c7b92dd
[udemy] Fix paid course detection (#13943) 2017-08-17 23:14:46 +07:00
Sergey M․ 93d0583e34
[pluralsight] Use RPC API for course extraction (closes #13937) 2017-08-17 22:45:40 +07:00
Genki Sky bfabd17b33 Add new extractor 2017-08-17 16:56:06 +08:00
Yen Chi Hsuan 25a6e769a1 [qqmusic] Fix tests and cleanup 2017-08-17 16:39:57 +08:00
Yen Chi Hsuan d22b67f356 Merge pull request #13805 from gam2046/master
Fix QQ Music url changed
2017-08-17 16:11:35 +08:00
Sergey M․ a1aa659662
[periscope] Renew HLS extraction (closes #13917) 2017-08-16 23:03:42 +07:00
Sergey M․ 4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats (closes #13919) 2017-08-15 23:58:00 +07:00
forDream 134d85a7bd [qqmusic] review 2017-08-15 13:14:35 +08:00
forDream 5c037c0d1f [qqmusic]support QQMusicSingerIE 2017-08-15 13:14:35 +08:00
forDream 5d1bd3b907 [qqmusic]update valid url 2017-08-15 13:14:34 +08:00
forDream 19ada898dc fix QQ Music Url changed 2017-08-15 13:14:34 +08:00
Sergey M․ da20951a57
[mixcloud] Extract decrypt key 2017-08-14 22:39:05 +07:00
Sergey M․ 16393d6535
release 2017.08.13 2017-08-13 08:58:30 +07:00
Sergey M․ 475bcb225f
[pornhub:playlistbase] Skip videos from drop-down menu for all playlists (closes #12819, closes #13902) 2017-08-13 07:53:02 +07:00
Sergey M․ b3c6515365
[fourtube] Add support for other sites (closes #6022, closes #7859, closes #13901) 2017-08-13 07:23:29 +07:00
Sergey M․ eb02940cc7
[generic] Add test for #13895 2017-08-13 01:11:27 +07:00
Sergey M․ 4ef9152428
[limelight] Improve embeds detection (closes #13895) 2017-08-13 00:58:39 +07:00
Sergey M․ 0c43a481b9
[reddit] Add extractors (closes #13847) 2017-08-12 23:43:51 +07:00
Sergey M․ 868f79db41
[extractor/common] Fix _media_formats 2017-08-12 19:24:26 +07:00
Sergey M․ 70851a95c3
[aparat] Extract all formats (closes #13887) 2017-08-12 17:18:23 +07:00
Sergey M․ e74e3b63e3
[YoutubeDL] Make sure format id is not empty 2017-08-12 17:14:11 +07:00
Sergey M․ ac8491fcca
[extractor/common] Make _family_friendly_search optional 2017-08-12 17:11:35 +07:00
Sergey M․ 82889d4ae5
[extractor/common] Respect source's type attribute for HTML5 media (closes #13892) 2017-08-12 16:48:11 +07:00
Sergey M․ 92a5c41532
[mixcloud] Fix play info decryption (closes #13885) 2017-08-12 16:30:50 +07:00
Sergey M․ 1663bd6e1c
[generic] Replace vzaar embed test 2017-08-11 22:02:00 +07:00
tetra-eder 41918eaa5c [generic] Add support for vzaar embeds 2017-08-11 22:00:39 +07:00
Sergey M․ 6ed99754bb
release 2017.08.09 2017-08-09 23:52:22 +07:00
Sergey M․ baba5f4d1d
[xxxymovies] Fix title extraction (closes #13868) 2017-08-09 23:46:49 +07:00
Sergey M․ dee04d24a4
[nick] Add support for nick.com.pl (closes #13860) 2017-08-09 23:12:02 +07:00
Sergey M․ 5b3ddadcc3
[mixcloud] Fix play info decryption (closes #13867) 2017-08-09 22:55:13 +07:00
Sergey M․ 5b232f46dc
[utils] Skip missing params in cli_bool_option (closes #13865) 2017-08-09 22:28:19 +07:00
Alex Seiler 4bf22f7a10 [20min] Fix embeds extraction 2017-08-08 05:41:38 +07:00
Sergey M․ 15d1e8a23d
[dplayit] Fix extraction (closes #13851) 2017-08-07 22:43:42 +07:00
Yen Chi Hsuan ee6a611665
[niconico] Support videos with multiple formats (closes #13522) 2017-08-07 00:19:46 +08:00
Yen Chi Hsuan 463e7216c8
[niconico] Support HTML5-only videos (closes #13806) 2017-08-06 23:07:28 +08:00
Sergey M․ 903a183b6a
release 2017.08.06 2017-08-06 09:05:36 +07:00
Sergey M․ fac188c695
[pluralsight] Fix format selection 2017-08-06 08:44:28 +07:00
Sergey M․ 16afce174e
[mpora] Remove extractor (closes #13826) 2017-08-06 08:18:16 +07:00
Sergey M․ e2b4808fd8
[voot] Improve extraction (#10255, closes #11814) 2017-08-06 08:05:29 +07:00
Ashutosh Chaudhary daaaf5f594
[voot] Add extractor 2017-08-06 08:05:24 +07:00
Sergey M․ f172c86dcd
[vlive:channel] Limit number of videos per page to 100 (closes #13830) 2017-08-05 21:17:55 +07:00
Sergey M․ 1d5472290f
[podomatic] Extend _VALID_URL (closes #13827) 2017-08-05 08:28:12 +07:00
Sergey M․ c983cc3b71
[cinchcast] Extend _VALID_URL 2017-08-05 08:17:01 +07:00
Sergey M․ 1141e9104b
Use relative paths for DASH fragments (closes #12990)
10x reduced JSON size
refs #13810
2017-08-05 07:40:29 +07:00
Sergey M․ 8519b88f67
[yandexdisk] Relax _VALID_URL (closes #13824) 2017-08-05 00:59:07 +07:00
Sergey M․ bbbe1cebfc
[mlb] Update test (closes #13777) 2017-08-05 00:09:36 +07:00
Sergey M․ f31fd0693b
[vidme] Extract DASH and HLS formats 2017-08-05 00:00:21 +07:00
Sergey M․ 799802f368
[teamfour] Remove extractor (closes #13782)
Now covered with generic extractor
2017-08-04 23:54:28 +07:00
Sergey M․ b3b5870cba
[pornhd] Fix extraction (closes #13783) 2017-08-04 23:51:03 +07:00
Sergey M․ 57a38a38c3
[udemy] Fix subtitles extraction (closes #13812) 2017-08-04 23:45:13 +07:00
Matt Crupi 11a6793f80 [mlb] Extend _VALID_URL (closes #13740) 2017-08-04 22:46:54 +07:00
Sergey M․ 183062a4ab
[pbs] Add support for new URL schema (closes #13801) 2017-08-03 23:19:59 +07:00
Tithen-Firion feee8d32e4 [phantomjs] add exe version to debug info 2017-08-03 14:17:25 +02:00
Sergey M․ 9118c9f18a
[nrktv] Update API host (closes #13796) 2017-08-01 05:21:00 +07:00
Sergey M․ 5c9ea67bc0
release 2017.07.30.1 2017-07-30 20:47:31 +07:00
Sergey M․ 8b9f50d7cb
[watchbox] Add extractor (#13739) 2017-07-30 19:09:44 +07:00
Sergey M․ 0ed4758023
[clipfish] Remove extractor 2017-07-30 19:08:44 +07:00
Sergey M․ a0a477b885
[youjizz] Fix extraction (closes #13744) 2017-07-30 15:48:22 +07:00
Grzegorz Ruciński 198d4cb40c [generic] Add support for another ooyala embed pattern (closes #13727) 2017-07-30 01:30:04 +07:00
Sergey M․ ca127ab2c1
[ard] Add support for lives (closes #13771) 2017-07-29 23:07:28 +07:00
Sergey M․ e445850e69
[soundcloud] Update client id 2017-07-29 18:45:57 +07:00
Sergey M․ 836ef26486
[soundcloud:trackstation] Add extractor (closes #13733) 2017-07-29 18:41:42 +07:00
Sergey M․ c04017519d
[svtplay] Use geo verification proxy for API request 2017-07-29 15:30:53 +07:00
Sergey M․ 2a7a823211
[svtplay] Update API URL (closes #13767) 2017-07-29 15:25:32 +07:00
Sergey M․ 95908ce453
[extractor/generic] PEP 8 2017-07-29 15:13:12 +07:00
Sergey M․ cbbe66635f
[yandexdisk] Add extractor (closes #13755) 2017-07-29 15:10:19 +07:00
Sergey M․ c5a49ff084
[downloader/hls] Use redirect URL as manifest base (#13755) 2017-07-29 15:02:41 +07:00
Philipp Hagemeister 24e966e8da [megaphone] Add extractor 2017-07-28 12:13:19 +02:00
Sergey M․ 9682666bda
[amcnetworks] Make rating optional (closes #12453) 2017-07-27 02:04:51 +07:00
Sergey M․ f9c48d895b
[cloudy] Fix extraction (closes #13737) 2017-07-26 23:12:43 +07:00
Sergey M․ c99d6890cb
[nickru] Add extractor 2017-07-23 21:02:06 +07:00
Sergey M․ 70bfab0e9a
[mtv] Improve thumbnal extraction 2017-07-23 21:02:06 +07:00
nyuszika7h f0e31e32c9 [nick] Automate geo-restriction bypass (#13711) 2017-07-23 20:40:04 +07:00
Yen Chi Hsuan e3ce912c3d
[niconico] improve error reporting (#13696) 2017-07-23 16:25:30 +08:00
Yen Chi Hsuan 905d18a7aa
[options] Correctly hide login info from debug outputs (#13696)
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
2017-07-23 16:22:14 +08:00
Sergey M․ 0db492c02a
release 2017.07.23 2017-07-23 01:09:09 +07:00
Sergey M․ 71dde5eecf
[itv] Fix production id extraction (closes #13671) 2017-07-23 00:59:07 +07:00
Sergey M․ 935d6c20c0
[vidio] Make duration non fatal and fix typo 2017-07-23 00:44:50 +07:00
Sergey M․ e0f1fb0a27
[mtv] Skip missing video parts (closes #13690) 2017-07-23 00:25:23 +07:00
Sergey M․ 0017d9ad6d
[YoutubeDL] Improve default format specification (closes #13704) 2017-07-23 00:12:01 +07:00
Sergey M․ 327c8364f1
[sportbox:embed] Fix extraction 2017-07-22 21:35:14 +07:00
dubber0 359aa2fdd1 [npo] Add support for npo3.nl URLs 2017-07-22 19:15:55 +07:00
Sergey M․ f76c02c87b
[dramafever] Fix tests 2017-07-22 11:41:40 +07:00
Sergey M․ 7d9a1db111
[dramafever] Remove video id from title (closes #13699) 2017-07-22 11:40:46 +07:00
Sergey M․ 0396806f67
[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent
All these meta fields must be borrowed from final extractor that actually performs extraction.
This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously
used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.
2017-07-21 00:13:32 +07:00
Sergey M․ dc6520aa3d
[egghead:lesson] Add extractor (#6635) 2017-07-20 23:22:36 +07:00
Sergey M․ c653326a14
[funnyordie] Extract more metadata (closes #13677) 2017-07-20 22:50:56 +07:00
Yen Chi Hsuan 3fcf346ac1
[youku:show] Refine playlist extraction
Handle playlists that the initial page is not the first page
2017-07-20 23:20:46 +08:00
Yen Chi Hsuan fa63cf6c23
[youku:show] Fix playlist extraction (closes #13248) 2017-07-20 22:57:51 +08:00
Yen Chi Hsuan 85f5a74b6c
[tbs] Mark as broken and skip invalid tests 2017-07-20 21:19:09 +08:00
Yen Chi Hsuan d20b1c6725
[dispeak] Recognize sevt subdomain (closes #13276) 2017-07-20 18:14:14 +08:00
Sergey M․ bb176df3bb
[spiegel:article] Move test 2017-07-17 22:19:40 +07:00
Sergey M․ 83d00044c1
[adn] Improve error reporting (#13663) 2017-07-16 20:50:32 +07:00
Sergey M․ 7abed4e06c
[crunchyroll] Relax series and season regex (closes #13659) 2017-07-16 12:40:45 +07:00
Sergey M․ 13eb526f11
[nexx:embed] PEP 8 2017-07-16 05:23:19 +07:00
Sergey M․ 00d06e3cfc
[spiegel:article] Add support for nexx iframe embeds (closes #13029) 2017-07-16 04:38:20 +07:00
Sergey M․ 749ca5eced
[extractor/common] Fix playlist_from_matches 2017-07-16 04:33:14 +07:00
Sergey M․ 3f59b0154a
[nexx:embed] Add extractor for iframe embeds 2017-07-16 04:32:37 +07:00
Sergey M․ 089b97cfee
[nexx] Improve JS embed extraction 2017-07-16 04:30:48 +07:00
Sergey M․ decf86044d
[pearvideo] Improve (closes #13031) 2017-07-16 03:06:04 +07:00
troywith77 94b817edeb
[pearvideo] Add extractor 2017-07-16 03:02:31 +07:00
Sergey M․ cea931a9e5
release 2017.07.15 2017-07-15 07:36:05 +07:00
Sergey M․ 961ea474b6
[YoutubeDL] PEP 8 2017-07-15 07:02:57 +07:00
Sergey M․ ea3f20494f
[youtube] PEP 8 2017-07-15 07:02:57 +07:00
Sergey M․ c7604d79e9
[spiegeltv] Delegate extraction to nexx (closes #13159) 2017-07-15 07:02:57 +07:00
Sergey M․ 4e826cd9ae
[nexx] Add extractor (closes #10807, closes #13465) 2017-07-15 07:02:57 +07:00
Robin Neatherway 2583c0b54e Fix bugs caused by typos 2017-07-14 23:08:32 +07:00
Sergey M․ 7d02dcfaa2
[youtube] Don't capture YouTube Red ad for creator meta field (closes #13621) 2017-07-14 22:37:04 +07:00
satunnainen 00dbdfc1f7 [slideshare] Fix extraction 2017-07-14 22:11:07 +07:00
rrooij f354d84807 [5tv] Add another video URL pattern (closes #13354) 2017-07-14 22:10:17 +07:00
Sergey M․ 15da37c7dc
[YoutubeDL] Don't expand env variables in meta fields (closes #13637) 2017-07-14 00:42:12 +07:00
Sergey M․ 9a0942ad55
[drtv] Make HLS and HDS extraction non fatal 2017-07-11 22:59:56 +07:00
Sergey M․ f2bb33a986
[ted] Fix subtitles extraction (closes #13628, closes #13629) 2017-07-11 21:36:45 +07:00
Yen Chi Hsuan 3615bfe1b4
[twitter] Fix remaining tests 2017-07-11 16:46:37 +08:00
Yen Chi Hsuan e8f20ffa03
[vine] Make sure the title won't be empty
And fix a relevant TwitterCard test case
2017-07-11 16:05:15 +08:00
Yen Chi Hsuan 9be31e771c
[twitter] Support HLS streams in vmap URLs 2017-07-11 15:48:48 +08:00
Yen Chi Hsuan 7f176ac477
[periscope] Support pscp.tv URLs in embedded frames
And fix a relevant twitter test
2017-07-11 15:35:19 +08:00
Yen Chi Hsuan 2edfd745df [twitter] Extract mp4 urls via mobile API (closes #12726) 2017-07-11 15:19:36 +08:00
Yen Chi Hsuan bb13949197 [niconico] Check login errors (#12486) 2017-07-11 15:03:11 +08:00
Yen Chi Hsuan c3c94ca4a4
[giantbomb] Extract m3u8 formats (closes #13626) 2017-07-10 21:34:27 +08:00
Sergey M․ e3cd1fcdd1
[vlive:playlist] Relax and simplify 2017-07-10 04:32:24 +07:00
coreynicholson b71c18b434 [vlive:playlist] Add extractor 2017-07-10 04:24:04 +07:00
Sergey M․ 7bf539edcc
[eagleplatform] Fix test 2017-07-10 00:14:41 +07:00
Sergey M․ 65c416dda8
release 2017.07.09 2017-07-09 20:16:38 +07:00
Sergey M․ 71a1db8919
[dailymail] Add support for embeds 2017-07-09 20:06:24 +07:00
Sergey M․ 6e925598d6
[csjw] Add coding cookie 2017-07-09 19:18:12 +07:00
Sergey M․ 73cf76a93f
[joj] Rewrite and add support for generic embeds (closes #13268) 2017-07-09 19:17:54 +07:00
luboss 256a746d21
[joj] Add extractor 2017-07-09 19:17:38 +07:00
Sergey M․ 58179eb7d9
[abc.net.au:iview] Extract more formats (closes #13492, closes #13489) 2017-07-09 17:55:40 +07:00
Sergey M․ 485cb37576
[egghead:course] Improve (closes #13370) 2017-07-09 17:30:49 +07:00
Santiago Calcagno ed84454d35
[egghead:course] Fix extraction 2017-07-09 17:30:25 +07:00
Sergey M․ a02682fd13
Keep in sync with ffmpeg's current malformed AAC bitstream wording (closes #13587) 2017-07-09 17:09:44 +07:00
Sergey M․ 0d2f0b0357
[csjw] Make description optional 2017-07-09 17:05:11 +07:00
Sergey M․ c319d1c483
[csjw] Fix issues and improve extraction (closes #13525) 2017-07-09 17:01:05 +07:00
Christopher Smith d2b9f362fa
[cjsw] Add extractor 2017-07-09 17:01:00 +07:00
Sergey M․ 4328ddf82b
[extractor/common] Add support for AMP tags in _parse_html5_media_entries 2017-07-09 16:29:52 +07:00
Sergey M․ 250b042c7e
[generic] Add tests for #13557 2017-07-09 16:02:38 +07:00
Sergey M․ 665e945246
[eagleplatform] Add support for referrer protected videos (closes #13557) 2017-07-09 15:57:58 +07:00
Sergey M․ 5af2fd7fa0
[eagleplatform] Add support for another embed pattern (#13557) 2017-07-09 15:55:04 +07:00
mlindner 15237fcd51 [veoh] Extend _VALID_URL 2017-07-09 14:54:52 +07:00
rrooij 7a57730907 [npo:live] Fix live stream id extraction (closes #13568) 2017-07-09 14:21:40 +07:00
Sergey M․ 8b347a389e
[googledrive] Fix height extraction (closes #13603) 2017-07-09 00:26:13 +07:00
Sergey M․ a49804816c
[dailymotion] Add support for new layout (close #13580) 2017-07-08 18:12:15 +07:00
Yen Chi Hsuan eadd313321
[yam] Remove extractor
mymedia.yam.com is dead. An wikipedia user also pointed out that Yam's
blog service is no longer available. [1]

[1] https://zh.wikipedia.org/zh-tw/%E5%A4%A9%E7%A9%BA%E9%83%A8%E8%90%BD
2017-07-08 15:48:05 +08:00
Sergey M․ d852c6bc59
[xhamster] Extract all formats and fix duration extraction (#13593) 2017-07-07 22:49:11 +07:00
Sergey M․ 00e5c36315
[xhamster] Add support for new URL schema (closes #13593) 2017-07-07 22:27:34 +07:00
Parmjit Virk 60d4401c5e [espn] Extend _VALID_URL (fixes #13244) 2017-07-06 22:55:59 +07:00
Sergey M․ 6554708252
[kaltura] Fix typo in subtitles extraction (closes #13569) 2017-07-05 23:20:50 +07:00
Sergey M․ 0a2e1b2e30
[vier] Adapt extraction to redesign (#13575) 2017-07-05 22:52:47 +07:00
Yen Chi Hsuan babbc04d45 [xuite] Move to the new HTML5 API and reduce # of requests 2017-07-05 23:27:12 +08:00
Yen Chi Hsuan 609ff8ca19 [utils] Support attributes with no values in get_elements_by_attribute() 2017-07-05 23:27:12 +08:00
Sergey M․ b6c9fe4162
release 2017.07.02 2017-07-02 20:17:10 +07:00
Sergey M․ 50ae3f646e
[thisoldhouse] Add more fallbacks for video id (closes #13541) 2017-07-02 20:06:15 +07:00
Parmjit Virk 99a7e76240
[thisoldhouse] Update test 2017-07-02 20:05:11 +07:00
Parmjit Virk a3a6d01a96
[thisoldhouse] Fix video id extraction (closes #13540) 2017-07-02 20:04:51 +07:00
Sergey M․ 02d61a65e2
[xfileshare] Extend format regex (closes #13536) 2017-07-02 08:00:22 +07:00
Sergey M․ 9b35297be1
[extractors] Add import for tastytrade 2017-07-01 18:39:29 +07:00
Sergey M․ 4917478803
[ted] Fix extraction (closes #13535)) 2017-07-01 18:39:01 +07:00
Sergey M․ 54faac2235
[tastytrade] Add extractor (closes #13521) 2017-06-30 22:20:30 +07:00
Sergey M․ c69701c6ab
[extractor/common] Improve _json_ld 2017-06-30 22:19:06 +07:00
Sergey M․ d4f8ce6e91
[dplayit] Relax video id regex (closes #13524) 2017-06-30 21:55:45 +07:00
Sergey M․ b311b0ead2
[generic] Extract more generic metadata (closes #13527) 2017-06-30 21:42:04 +07:00
Sergey M․ 72d256c434
[bbccouk] Extend _VALID_URL 2017-06-29 22:29:28 +07:00
Sergey M․ b2ed954fc6
[bbccouk] Capture and output error message (closes #13518) 2017-06-29 22:27:53 +07:00
Sergey M․ a919ca0ad6
[cbsnews] Actualize test 2017-06-28 22:30:12 +07:00
Parmjit Virk 88d6b7c2bd [cbsnews] Relax video info regex (fixes #13284) 2017-06-28 22:21:35 +07:00
Sergey M․ fd1c5fba6b
[facebook] Add test for plugin video embed (#13493) 2017-06-27 22:38:59 +07:00
Sergey M․ 0646e34c7d
[facebook] Add support for plugin video embeds and multiple embeds (closes #13493) 2017-06-27 22:38:54 +07:00
Sergey M․ bf2dc9cc6e
[soundcloud] Fix tests 2017-06-27 21:26:46 +07:00
Viktor Szakats f1c051009b [soundcloud] Switch to https for API requests 2017-06-27 21:20:18 +07:00
Sergey M․ 33ffb645a6
[pandatv] Switch to https for API and download URLs 2017-06-26 22:11:09 +07:00
Xuan Hu (Sean) 35544690e4 [pandatv] Add support for https URLs 2017-06-26 22:00:31 +07:00
Luca Steeb 4a87de72df [niconico] fix sp subdomain links 2017-06-25 21:30:05 +02:00
Sergey M․ a7ce8f16c4
release 2017.06.25 2017-06-25 05:16:06 +07:00
Sergey M․ 0c7a631b61
[adobepass] Add support for ATTOTT MSO (DIRECTV NOW) (closes #13472) 2017-06-25 05:03:17 +07:00
Sergey M․ fd9ee4de8c
[wsj] Add support for barrons.com (closes #13470) 2017-06-25 02:15:35 +07:00
Argn0 5744cf6c03 [ign] Add another video id pattern (closes #13328) 2017-06-25 01:59:15 +07:00
Sergey M․ 9c48b5a193
[raiplay:live] Improve and add test (closes #13414) 2017-06-25 01:49:27 +07:00
james 449c665776
[raiplay:live] Add extractor 2017-06-25 01:48:54 +07:00
Sergey M․ 23aec3d623
[redbulltv] Restore hls format prefix 2017-06-25 01:10:31 +07:00
Sergey M․ 27449ad894
[redbulltv] Add support for lives and segments (closes #13486)) 2017-06-25 01:09:12 +07:00
Sergey M․ bd65f18153
[onetpl] Add support for videos embedded via pulsembed (closes #13482) 2017-06-24 18:33:31 +07:00
Sergey M․ 73af5cc817
[YoutubeDL] Skip malformed formats for better extraction robustness 2017-06-23 21:18:33 +07:00
Sergey M․ b5f523ed62
[ooyala] Add test for missing stream['url']['data'] 2017-06-23 20:56:48 +07:00
Sergey M․ 4f4dd8d797
[ooyala] Make more robust 2017-06-23 20:56:21 +07:00
Sergey M․ 4cb18ab1b9
[ooyala] Skip empty format URLs (closes #13471, closes #13476) 2017-06-23 20:50:48 +07:00
Sergey M․ ac7409eec5
[hgtv.com:show] Fix typo 2017-06-23 02:54:12 +07:00
Sergey M․ 170719414d
release 2017.06.23 2017-06-23 02:13:21 +07:00
Sergey M․ ddbb4c5c3e
[youtube] Adapt to new automatic captions rendition (closes #13467) 2017-06-23 02:00:19 +07:00
Sergey M․ fa3ea7223a
[hgtv.com:show] Relax video config regex and update test (closes #13279, closes #13461) 2017-06-23 00:42:42 +07:00
Parmjit Virk 0f4a5a73e7 [drtuber] Fix formats extraction (fixes 12058) 2017-06-23 00:08:36 +07:00
Sergey M․ 18166bb8e8
[youporn] Fix upload date extraction 2017-06-22 00:47:02 +07:00
Sergey M․ d4893e764b
[youporn] Improve formats extraction 2017-06-22 00:40:15 +07:00
Sergey M․ 97b6e30113
[youporn] Fix title extraction (closes #13456) 2017-06-22 00:20:45 +07:00
Sergey M․ 9be9ec5980
[googledrive] Fix formats' sorting (closes #13443) 2017-06-20 22:58:33 +07:00
Giuseppe Fabiano 048b55804d [watchindianporn] Fix extraction (closes #13411) 2017-06-20 04:30:45 +07:00
Giuseppe Fabiano 6ce79d7ac0 [abcotvs] Fix test md5 2017-06-20 04:07:00 +07:00
Sergey M․ 1641ca402d
[vimeo] Add fallback mp4 extension for original format 2017-06-20 01:27:59 +07:00
Sergey M․ 85cbcede5b
[ruv] Improve, extract all formats and metadata (closes #13396) 2017-06-19 23:46:03 +07:00
Orn a1de83e5f0
[ruv] Add extractor 2017-06-19 23:45:45 +07:00
Sergey M․ fee00b3884
[viu] Fix extraction on older python 2.6 2017-06-19 22:57:37 +07:00
Sergey M․ 2d2132ac6e
[adobepass] Fix extraction on older python 2.6 2017-06-19 22:54:53 +07:00
Yen Chi Hsuan cc2ffe5afe
[pandora.tv] Fix upload_date extraction (closes #12846) 2017-06-19 16:20:36 +08:00
Sergey M․ 560050669b
[asiancrush] Add extractor (closes #13420) 2017-06-18 20:18:51 +07:00
Sergey M․ eaa006d1bd
release 2017.06.18 2017-06-18 00:16:49 +07:00
Sergey M․ 1433734c35
[downloader/common] Use utils.shell_quote for debug command line 2017-06-17 23:50:21 +07:00
Sergey M․ aefce8e6dc
[utils] Use compat_shlex_quote in shell_quote 2017-06-17 23:48:58 +07:00
Sergey M․ 8b6ac49ecc
[postprocessor/execafterdownload] Encode command line (closes #13407) 2017-06-17 23:16:53 +07:00
Sergey M․ b08e235f09
[compat] Fix compat_shlex_quote on Windows (closes #5889, closes #10254) 2017-06-17 23:14:24 +07:00
Sergey M․ be80986ed9
[postprocessor/metadatafromtitle] Fix missing optional meta fields (closes #13408) 2017-06-17 19:05:10 +07:00
Jakub Adam Wieczorek b230fefc3c [polskieradio] Fix extraction 2017-06-16 04:57:56 +07:00
Sergey M․ 96a2daa1ee
[extractor/common] Improve jwplayer subtitles extraction 2017-06-15 23:40:39 +07:00
gfabiano 0ea6efbb7a [xfileshare] Add support for fastvideo.me 2017-06-15 21:41:49 +07:00
Yen Chi Hsuan 6a9cb29509
[extractor/common] Fix json dumping with --geo-bypass
The line "[debug] Using fake IP %s (%s) as X-Forwarded-For." was printed
to stdout even with -j/-J, which breaks the resultant JSON.
2017-06-15 13:04:36 +08:00
Yen Chi Hsuan ca27037171
[bilibili] Fix extraction of videos with double quotes in titles
Closes #13387
2017-06-15 11:19:03 +08:00
gfabiano 0bf4b71b75 [4tube] Fix extraction (closes #13381) 2017-06-15 04:16:50 +07:00
Marcin Cieślak 5215f45327 [disney] Add support for disneychannel.de 2017-06-15 04:13:04 +07:00
Sergey M․ 0a268c6e11
[extractor/common] Improve jwplayer formats extraction (closes #13379) 2017-06-14 22:02:15 +07:00
Sergey M․ 7dd5415cd0
[npo] Improve _VALID_URL (closes #13376) 2017-06-14 21:33:40 +07:00
Sergey M․ b5dc33daa9
[corus] Add support for showcase.ca 2017-06-13 23:27:27 +07:00
Sergey M․ 97fa1f8dc4
[corus] Add support for history.ca (closes #13359) 2017-06-13 23:16:21 +07:00
Sergey M․ b081f53b08
[compat] Add compat_HTMLParseError to __all__ 2017-06-12 02:36:43 +07:00
Sergey M․ cb1e6d8985
release 2017.06.12 2017-06-12 02:23:17 +07:00
Sergey M․ bf87c36c93
[xfileshare] PEP 8 2017-06-12 02:01:12 +07:00
Sergey M․ b4a3d461e4
[utils] Handle HTMLParseError in extract_attributes (closes #13349) 2017-06-12 01:52:24 +07:00
Sergey M․ 72b409559c
[compat] Introduce compat_HTMLParseError 2017-06-12 01:50:32 +07:00
Sergey M․ 534863e057
[xfileshare] Add support for rapidvideo (closes #13348) 2017-06-12 00:16:47 +07:00
Sergey M․ 16bc958287
[xfileshare] Modernize and pass referrer 2017-06-12 00:14:04 +07:00
Sergey M․ 624bd0104c
[rutv] Add support for testplayer.vgtrk.com (closes #13347) 2017-06-11 21:36:19 +07:00
Sergey M․ 28a4d6cce8
[newgrounds] Extract more metadata (closes #13232) 2017-06-11 21:30:06 +07:00
Sergey M․ 2ae2ffda5e
[utils] Improve unified_timestamp 2017-06-11 21:27:22 +07:00
Sergey M․ 70e7967202
[newgrounds:playlist] Add extractor (closes #10611) 2017-06-11 20:50:55 +07:00
Sergey M․ 6e999fbc12
[newgrounds] Improve formats and uploader extraction (closes #13346) 2017-06-11 19:44:44 +07:00
Sergey M․ 7409af9eb3
[msn] Fix formats extraction 2017-06-11 08:56:53 +07:00
Sergey M․ 4e3637034c
[extractor/generic] Ensure format id is unicode string 2017-06-10 23:56:20 +07:00
Sergey M․ 1afd0b0da7
[extractor/common] Return unicode string from _match_id 2017-06-09 00:40:03 +07:00
Sergey M․ 7515830422
[turbo] Ensure format id is string 2017-06-09 00:31:56 +07:00
Sergey M․ f5521ea209
[sexu] Ensure height is int 2017-06-09 00:30:23 +07:00
Sergey M․ 34646967ba
[jove] Ensure comment count is int 2017-06-09 00:29:20 +07:00
Sergey M․ e4d2e76d8e
[golem] Ensure format id is string 2017-06-09 00:27:11 +07:00
Sergey M․ 87f5646937
[gfycat] Ensure filesize is int 2017-06-09 00:24:23 +07:00
Sergey M․ cc69a3de1b
[foxgay] Ensure height is int 2017-06-09 00:22:14 +07:00
Sergey M․ 15aeeb1188
[flickr] Ensure format id is string 2017-06-09 00:20:07 +07:00
Sergey M․ 1693bebe4d
[sohu] Fix numeric fields 2017-06-09 00:16:42 +07:00
Sergey M․ 4244a13a1d
[safari] Improve authentication detection (closes #13319) 2017-06-08 23:20:48 +07:00
Sergey M․ 931adf8cc1
[liveleak] Ensure height is int (closes #13313) 2017-06-08 22:54:30 +07:00
Sergey M․ c996943418
[YoutubeDL] Sanitize more fields (#13313) 2017-06-08 22:53:14 +07:00
Sergey M․ a355b57f58
[README.md] Clarify output template references (closes #13316) 2017-06-08 21:52:19 +07:00
Sergey M․ 1508da30c2
[streamango] Skip download for test (closes #13292) 2017-06-07 21:53:40 +07:00
Luca Steeb eb703e5380
[streamango] Make title optional 2017-06-07 21:53:33 +07:00
Sergey M․ 0a3924e746
[rtlnl] Improve _VALID_URL (closes #13295) 2017-06-06 21:21:44 +07:00
Sergey M․ e1db730d86
[tvplayer] Fix extraction (closes #13291) 2017-06-06 00:13:57 +07:00
Sergey M․ 537191826f
release 2017.06.05 2017-06-05 00:48:07 +07:00
Sergey M․ 6d923aab35
[bandcamp:weekly] Improve and extract more metadata (closes #12758) 2017-06-04 23:21:30 +07:00
Adam Voss 62bafabc09
[bandcamp:weekly] Add extractor 2017-06-04 23:21:07 +07:00
Sergey M․ 9edcdac90c
[pornhub:uservideos] Add missing raise 2017-06-04 20:39:55 +07:00
Sergey M․ cd138d8bd4
[pornhub:playlist] Fix extraction (closes #13281) 2017-06-04 15:54:19 +07:00
Sergey M․ cd750b731c
[godtv] Remove extractor (closes #13175) 2017-06-03 22:08:12 +07:00
CeruleanSky 4bede0d8f5 [YoutubeDL] Don't emit ANSI escape codes on Windows 2017-06-03 19:14:23 +07:00
Sergey M․ f129c3f349
[safari] Fix typo (closes #13252) 2017-06-02 01:03:51 +07:00
Sergey M․ 39d4c1be4d
[youtube] Improve chapters extraction (closes #13247) 2017-06-01 23:29:45 +07:00
Sergey M․ f7a747ce59
[1tv] Lower preference for http formats (closes #13246) 2017-06-01 22:19:52 +07:00
Sergey M․ 4489d41816
[francetv] Relax _VALID_URL 2017-06-01 00:15:15 +07:00
Sergey M․ 87b5184a0d
[drbonanza] Fix extraction (closes #13231) 2017-05-31 23:56:32 +07:00
Remita Amine c56ad5c975 [packtpub] Fix authentication(closes #13240) 2017-05-31 15:44:29 +01:00
Sergey M․ 941ea38ef5
release 2017.05.29 2017-05-29 00:42:18 +07:00
Yen Chi Hsuan a49eccdfa7
[youtube] Parse player_url if format URLs are encrypted or DASH MPDs are requested
Fixes #13211
2017-05-28 20:20:20 +08:00
Sergey M․ a846173d93
[xhamster] Simplify (closes #13216) 2017-05-28 07:55:56 +07:00
fiocfun 78e210dea5
[xhamster] Fix author and like/dislike count extraction 2017-05-28 07:55:07 +07:00
Sergey M․ 8555204274
[xhamster] Extract categories (closes #11728) 2017-05-28 07:50:15 +07:00
Sergey M․ 164fcbfeb7
[abcnews] Improve and remove duplicate test (closes #12851) 2017-05-28 07:06:56 +07:00
Tithen-Firion bc22df29c4
[abcnews] Add support for embed URLs 2017-05-28 07:06:29 +07:00
Sergey M․ 7e688d2f6a
[gaskrank] Improve (closes #12493) 2017-05-28 06:47:38 +07:00
motophil 5a6d1da442
[gaskrank] Fix extraction 2017-05-28 06:47:30 +07:00
Sergey M․ 703751add4
[medialaan] PEP 8 (closes #12774) 2017-05-28 06:27:57 +07:00
midas02 4050be78e5
[medialaan] Fix videos with missing videoUrl
A rough trick to get around the two different json styles medialaan seems to be using.
Fix for these example videos:
https://vtmkzoom.be/video?aid=45724
https://vtmkzoom.be/video?aid=45425
2017-05-28 06:27:52 +07:00
Sergey M․ 4d9fc40100
[dvtv] Improve and fix playlists support (closes #13063) 2017-05-28 06:19:54 +07:00
Jan Kundrát 765522345f
[dvtv] Parse adaptive formats as well
The old code hit an error when it attempted to parse the string
"adaptive" for video height. Actually parsing the returned playlists is
a good idea because it adds more output formats, including some
audio-only-ones.
2017-05-28 06:19:46 +07:00
Sergey M․ 6bceb36b99
[beam] Improve and add support for mixer.com (closes #13032) 2017-05-28 05:43:04 +07:00
Mike Fährmann 1e0d65f0bd
[beam:vod] Add extractor 2017-05-28 05:42:23 +07:00
Sergey M․ 03327bc9a6
[cbsinteractive] Relax _VALID_URL (closes #13213) 2017-05-27 22:37:24 +07:00
Yen Chi Hsuan b407d8533d
[utils] Drop an compatibility wrapper for Python < 2.6
addinfourl.getcode is added since Python 2.6a1. As youtube-dl now
requires 2.6+, this is no longer necessary.

See 9b0d46db11
2017-05-27 23:05:02 +08:00
Remita Amine 20e2c9de04 [adn] fix formats extraction 2017-05-26 20:00:44 +01:00
Yen Chi Hsuan d16c0121b9
[youku] Extract more metadata (closes #10433) 2017-05-27 00:08:37 +08:00
Sergey M․ 7f4c3a7439
[cbsnews] Fix extraction (closes #13205) 2017-05-26 22:42:27 +07:00
Sergey M․ 28dbde9cc3
release 2017.05.26 2017-05-26 22:29:16 +07:00
Yen Chi Hsuan fd545fc6d1
Revert "[youtube] Don't use the DASH manifest from 'get_video_info' if 'use_cipher_signature' is True (#5118)"
This reverts commit 87dc451108.
2017-05-26 23:22:54 +08:00
Sergey M․ 97067db2ae
[bbc] Add support for authentication 2017-05-26 22:12:24 +07:00
Yen Chi Hsuan c130f0a37b
[tudou] Merge into youku extractor (fixes #12214)
Also, there are no tudou playlists anymore. All playlist URLs points to youku
playlists.
2017-05-26 23:04:42 +08:00
Yen Chi Hsuan d3d4ba7f24
[youku:show] Fix extraction 2017-05-26 21:59:16 +08:00
Yen Chi Hsuan 5552c9eb0f
[utils] Recognize more patterns in strip_jsonp()
Used in Youku Show pages
2017-05-26 21:58:18 +08:00
Yen Chi Hsuan 59ed87cbd9
[youku] Fix extraction (closes #13191) 2017-05-26 19:16:52 +08:00
Sergey M․ b7f8749304
[udemy] Fix extraction for outputs' format entries without URL (closes #13192) 2017-05-25 22:28:26 +07:00
Yen Chi Hsuan 5192ee17e7
[postprocessor/ffmpeg] Fix metadata filename handling on Python 2
Fixes #13182
2017-05-25 22:07:03 +08:00
Sergey M․ e834f04400
[vimeo] Fix formats' sorting (closes #13189) 2017-05-24 22:58:16 +07:00
Remita Amine 884d09f330 [cbsnews] fix extraction for 60 Minutes videos 2017-05-24 09:44:41 +01:00
remitamine 9e35298f97 Merge pull request #12861 from Tithen-Firion/cbsinteractive-fix
[cbsinteractive] update extractor and test cases
2017-05-24 10:21:33 +02:00
Sergey M․ 2570e85167
release 2017.05.23 2017-05-23 00:17:48 +07:00
Sergey M․ a609e61a90
[downloader/external] Pass -loglevel to ffmpeg downloader (closes #13183) 2017-05-22 23:40:07 +07:00
Ondřej Caletka afdb387cd8 [streamcz] Add support for subtitles 2017-05-21 15:41:52 +07:00
Sergey M․ dc4e4f90a2
[youtube] Modernize 2017-05-21 01:18:56 +07:00
Protuhj fdc20f87a6 [youtube] Fix DASH manifest signature decryption (closes #8944) 2017-05-21 01:11:37 +07:00
Sergey M․ 35a2d221a3
[toggle] Relax _VALID_URL (closes #13172) 2017-05-20 23:06:30 +07:00
Nii-90 daa4e9ff90 [adobepass] Add support for Brighthouse MSO 2017-05-20 20:50:46 +07:00
Sergey M․ 2ca29f1aaf
[toypics] Improve and modernize 2017-05-20 01:29:33 +07:00
vobe 77d682da9d [toypics] Fix extraction 2017-05-20 01:18:03 +07:00
Sergey M․ 8fffac6927
[njpwworld] Fix extraction (closes #13162) 2017-05-19 23:11:02 +07:00
Sergey M․ 5f6fbcea08
[hitbox] Add support for smashcast.tv (closes #13154) 2017-05-19 22:34:00 +07:00
Logan B 00cb0faca8 [mitele] Update app key regex 2017-05-19 21:54:57 +07:00
Sergey M․ bfdf6fcc66
release 2017.05.18.1 2017-05-18 23:00:03 +07:00
Sergey M․ 0e2d626ddd
[jsinterp] Fix typo and cleanup regexes (closes #13134) 2017-05-18 22:57:38 +07:00
Sergey M․ 9d63e57d1f
release 2017.05.18 2017-05-18 22:30:37 +07:00
Sergey M․ 7769f83701
[jsinterp] Add support for quoted names and indexers (closes #13123, closes #13130) 2017-05-18 22:18:33 +07:00
Sergey M․ 650bd94716
[vier] Relax regexes and extract more metadata (closes #12539) 2017-05-17 23:39:01 +07:00
mrBliss 36b226d48f
[vier] Extract more info
Extract the `episode_number` and `upload_date`. Also extract the real
`description`.
2017-05-17 23:38:50 +07:00
Sergey M․ f2e2f0c777
[extractor/common] Fix rtmp and rtsp formats' URLs in _extract_wowza_formats 2017-05-17 22:20:25 +07:00
Sergey M․ 6f76679804
[extractor/common] Add support for schemeless URLs in _extract_wowza_formats (closes #13088, closes #13092) 2017-05-16 22:11:34 +07:00
Sergey M․ 7073015a23
[vier] PEP 8 and cleanup 2017-05-15 22:00:53 +07:00
mrBliss 89fd03079b [vier] Improve extraction
+ Add support for authentication
* Bypass authentication when no credentials provded
* Improve extraction robustness
2017-05-15 21:46:55 +07:00
Sergey M․ 1c45b7a8a9
[dailymail] Fix sources extraction (closes #13057) 2017-05-14 12:47:19 +07:00
Sergey M․ 60f5c9fb19
[utils] Recognize more audio codecs (#13081) 2017-05-14 12:33:33 +07:00
Sergey M․ c360e641e9
[dailymotion] Extend _VALID_URL (closes #13079) 2017-05-14 09:55:40 +07:00
Sergey M․ 6f3c632c24
release 2017.05.14 2017-05-14 07:38:40 +07:00
Sergey M․ 166d12b00c
[options] PEP 8 2017-05-14 07:33:24 +07:00
Sergey M․ 2b8e6a68f8
[extractor/generic] Add test for mediaset embed 2017-05-14 06:40:19 +07:00
Sergey M․ d105a7edc6
[mediaset] Fix upload date 2017-05-14 06:39:47 +07:00
Sergey M․ 5d29af3d15
[extractor/generic] Add support for mediaset embeds 2017-05-14 06:29:16 +07:00
Sergey M․ ca04de463d
[mediaset] Add support for shortcut 2017-05-14 06:28:40 +07:00
Sergey M․ 946826eec7
[extractor/generic] Remove duplicate limelight code 2017-05-14 06:17:34 +07:00
Sergey M․ 76d5a36391
[extractor/common] Respect Width and Height attributes in ISM manifests 2017-05-14 06:11:45 +07:00
Sergey M․ 56f9c77f0e
[mediaset] Improve extraction (closes #12708, closes #12964) 2017-05-14 05:30:13 +07:00
Timendum 0de136341a
[mediaset] Add extractor 2017-05-14 05:30:02 +07:00
Sergey M․ 1339ecb2f8
[orf:radio] Cleanup _VALID_URLs (closes #11643) 2017-05-14 04:31:20 +07:00
phaer efe9316703
[orf:radio] Fix extraction
Since oe1.orf.at has been updated, both ORF radios supported by youtube_dl
use the same API. This commit honors this fact by merging both extractors
into one.
2017-05-14 04:31:14 +07:00
Luca Steeb 851a01aed6 [aljazeera] Extend _VALID_URL 2017-05-14 00:57:02 +07:00
Sergey M․ b845766597
[imdb] Relax _VALID_URL (closes #13056) 2017-05-14 00:32:50 +07:00
Sergey M․ fa26734e07
[postprocessor/metadatafromtitle] Add support regex syntax for --metadata-from-title (closes #13065) 2017-05-14 00:03:15 +07:00
Sergey M․ 12f01118b0
[francetv] Add support for mobile.france.tv (closes #13068) 2017-05-13 21:57:00 +07:00
Sergey M․ 7fc60f4ee9
[upskill] Add extractor (closes #13043) 2017-05-13 21:52:59 +07:00
Sergey M․ 58bb440283
[extractor/generic] Extract wistia embed code into separate method 2017-05-13 21:51:58 +07:00
Remita Amine 7ad4362357 [thescene] fix extraction(closes #13061) 2017-05-12 16:37:09 +01:00
Remita Amine 6c52477f59 [condenast] improve embed support 2017-05-12 16:37:09 +01:00
Yen Chi Hsuan 116283ff64
[liveleak] Fix extraction (#12053) 2017-05-12 19:15:33 +08:00
Yen Chi Hsuan 7274f3d0e9
[douyu] Support Douyu shows (closes #12228) 2017-05-12 18:44:24 +08:00
Sergey M․ 3166b1f0ac
[myspace] Improve _VALID_URL (closes #13040) 2017-05-10 22:35:46 +07:00
Remita Amine 39ee263819 use platform=desktop in assets url(closes #13041) 2017-05-10 08:50:30 +01:00
Sergey M․ a7ed6b341c
release 2017.05.09 2017-05-09 04:20:13 +07:00
Sergey M․ 6d1ded7502
[francetv] Adapt to site redesign (closes #13034) 2017-05-09 23:07:01 +07:00
Remita Amine 5d0968f0af [packtpub] add support for authentication(closes #12622) 2017-05-09 11:15:14 +01:00
Sergey M․ 8d65880e24
[drtv] Improve extraction and update tests (closes #13013, closes #13016) 2017-05-09 15:37:09 +07:00
Rasmus Rendal b972fb037b
[drtv] Lower preference for SignLanguage formats (closes #13013) 2017-05-09 15:36:02 +07:00
Remita Amine 5996d21aea [cspan] add support for brightcove live embeds(closes #13028) 2017-05-09 00:51:12 +01:00
Remita Amine afa0200bf0 [vrv] extract dash formats and subtitles 2017-05-08 20:04:40 +01:00
Sergey M․ e9137224b3
[YoutubeDL] Force restrict filenames when no locale is set for python 2 as well (#13027) 2017-05-09 01:14:02 +07:00
Remita Amine 804181dda9 [funimation] remove codes related to old login method and update test 2017-05-08 18:58:13 +01:00
Remita Amine 8fa17117df [funimation] fix authentication(closes #13021) 2017-05-08 18:13:58 +01:00
Remita Amine 3b859145c2 [adultswim] Fix Extraction(closes #8640)(closes #10950)(closes closes #11042)(closes #12121)
- add support for adobe pass authentication
- add support for live streams
- add support for show pages
2017-05-08 15:07:40 +01:00
Remita Amine 04c09f1961 [turner] extract thumbnail and is_live and strip description 2017-05-08 15:07:40 +01:00
Sergey M․ bf82b87323
[nonktube] Use econfig nuevo URL 2017-05-08 20:13:22 +07:00
Sergey M․ b6eb74e340
[nonktube] Add extractor (closes #8647, closes #13024) 2017-05-08 20:10:39 +07:00
Sergey M․ 3d40084b83
[nuevo] Pass headers to _extract_nuevo 2017-05-08 20:03:38 +07:00
Remita Amine 52294cdda7 [nbc] remove unused imports and extract permalink from modified urls 2017-05-07 09:31:14 +01:00
Remita Amine 2eeb588efe [nbc] improve extraction(closes #12364) 2017-05-07 08:59:31 +01:00
Sergey M․ 4ac0f573ef
release 2017.05.07 2017-05-07 04:51:34 +07:00
Sergey M․ 3995d37da5
[youtube] Fix TFA (#12927) 2017-05-07 04:19:11 +07:00
Sergey M․ e00eb564e9
[youtube] Fix authentication (closes #12927) 2017-05-06 23:58:47 +07:00
Yen Chi Hsuan 10c87c151b
[utils] Rename try_multipart_encode to _multipart_encode_impl
To state that this is an internal function and people should be careful
when using it outside youtube-dl.
2017-05-06 19:06:18 +08:00
Yen Chi Hsuan 228cd9bb90
[bilibili] Fix video downloading (closes #13001) 2017-05-06 18:58:38 +08:00
Sergey M․ 566fbbaefd
[rmcdecouverte] Improve (closes #12937) 2017-05-06 17:56:10 +07:00
midas02 74c09c852a
[rmcdecouverte] Fix extraction 2017-05-06 17:56:10 +07:00
Remita Amine fd178b8748 [theplatform] extract chapters 2017-05-06 07:19:07 +01:00
Tithen-Firion 1f9fefe7f5 [crackle] Update test 2017-05-06 03:39:14 +07:00
Luca Steeb 8b4774dcac [bandcamp] Fix thumbnail extraction 2017-05-06 03:35:42 +07:00
Sergey M․ a99cc4ca16
[pornhub] Extend _VALID_URL (closes #12996) 2017-05-06 02:46:37 +07:00
Sergey M․ 9cafc3fd8b
[youtube] Extract chapters 2017-05-06 02:27:06 +07:00
Sergey M․ 329e3dd5ad
[nrk] Extract chapters 2017-05-05 22:59:15 +07:00
Remita Amine 1d9e0a4f40 [vice] update tests and add support for ooyala embeds in article pages 2017-05-05 16:13:12 +01:00
Sergey M․ 7ad53cb7ff
[laola1tv] PEP 8 2017-05-05 21:59:23 +07:00
Yen Chi Hsuan b2ad479d17
[utils] Fix multipart_encode for Python < 3.5 2017-05-05 20:51:59 +08:00
Yen Chi Hsuan 4ac6dc3732
[vice] Support Vice articles (closes #12968) 2017-05-05 20:26:51 +08:00
Yen Chi Hsuan cc7bda4fff
[vice] Fix extraction for non en_us videos (closes #12967) 2017-05-05 20:01:02 +08:00
Yen Chi Hsuan 50ad078b7b
[gdcvault] Fix extraction for videos with gdc-player.html
Closes #12733
2017-05-05 15:13:40 +08:00
Sergey M․ 4947f13cd0
[pbs] Improve multipart video support (closes #12981) 2017-05-04 22:42:49 +07:00
Sergey M․ 7f09e523e8
[laola1tv:embed] Fix tests 2017-05-04 22:41:47 +07:00
Remita Amine 4fe14732a2 [laola1tv] fix extraction(closes #12880) 2017-05-04 16:07:08 +01:00
Remita Amine ff6f9a6704 [extractor/common] fix typo in _extract_akamai_formats 2017-05-04 16:07:08 +01:00
Tithen-Firion c89267d31a Merge branch 'master' into openload-phantomjs-method 2017-05-04 11:00:06 +02:00
Yen Chi Hsuan 0c26548601
[cda] Implement birthday verification (closes #12789) 2017-05-04 16:26:17 +08:00
Yen Chi Hsuan 5401bea27f
[leeco] Fix extraction (closes #12974)
Seems on mobile devices a similar API is used, but I always get an AD
with mimicking that API.
2017-05-04 03:18:56 +08:00
remitamine 7a6d33a9a5 [pbs] extract chapters information 2017-05-02 20:41:48 +01:00
remitamine fa2a36d9bc [ffmpeg] add support for chapters field postprocessing 2017-05-02 20:41:48 +01:00
remitamine 55949fede6 [common] introduce chapters field 2017-05-02 20:41:48 +01:00
Remita Amine 7fc875195f [amp] imporove thumbnail and subtitle extraction 2017-05-02 00:06:58 +01:00
Tithen-Firion c6fe5a7e12 [douyutv] Update test 2017-05-02 03:45:27 +08:00
Tithen-Firion ae21d2fd94 [dotsub] Update test 2017-05-02 02:56:44 +08:00
Tithen-Firion 77481f1386 [democracynow] Update test 2017-05-02 01:38:31 +07:00
Tithen-Firion d86d169dd5 [dailymotion] Add working test 2017-05-02 01:37:23 +07:00
Tithen-Firion b9f9f361fa [crunchyroll] Update test 2017-05-02 00:56:51 +07:00
Remita Amine ab39a25c75 [foxsports] fix extraction(closes #12945) 2017-05-01 09:02:41 +01:00
Tithen-Firion a146fa1c68 [coub] Update test and remove comment count extraction 2017-05-01 05:54:44 +07:00
Sergey M․ e0c1e9a98c
release 2017.05.01 2017-05-01 01:39:52 +07:00
Sergey M․ 74da856544
[infoq] Make audio format extraction non fatal (closes #12938) 2017-05-01 01:23:05 +07:00
Sergey M․ 9edf47df7b
[brightcove] Allow whitespace around attribute names in embedded code 2017-05-01 01:03:47 +07:00
Sergey M․ 238cec17ae
[extractor/anvato] PEP 8 2017-04-30 22:04:21 +07:00
Sergey M․ 50534b7158
[downloader/fragment] PEP 8 2017-04-30 22:04:01 +07:00
Sergey M․ 9cd4209724
[zaq1] Improve extraction (closes #12693) 2017-04-30 21:46:05 +07:00
Sergey M․ 33a81c2c6f
[extractor/common] Extract view count from JSON-LD 2017-04-30 21:45:59 +07:00
Sergey M․ deef31955b
[utils] Improve unified_timestamp
Seen at http://zaq1.pl/video/xev0e
2017-04-30 21:45:53 +07:00
slocum 9dac2cec2d
[zaq1] Add new extractor 2017-04-30 21:45:47 +07:00
Sergey M․ 6ec371cd9e
[xvideos] Extract og:duration (closes #12828) 2017-04-30 18:14:01 +07:00
Sander 13081db1f5
[xvideos] Add video duration 2017-04-30 18:10:49 +07:00
Sergey M․ b07ea5eaec
[vevo] Modernize 2017-04-30 17:58:22 +07:00
gritstub 5599253009 [vevo] Fix extraction (config.token.key) 2017-04-30 17:56:10 +07:00
Remita Amine 98ce1a3fd3 [utils] add video/mp2t to mimetype2ext 2017-04-30 09:03:10 +01:00
Remita Amine 5ff1bc0cc1 [YoutubeDL] write raw subtitle files 2017-04-29 20:03:03 +01:00
Yen Chi Hsuan ba5c3caf88
[washingtonpost] Fix invalid escape sequence on Python 3.6 2017-04-30 02:15:28 +08:00
Sergey M․ b5c39537be
[noovo] Improve extraction (closes #12792) 2017-04-30 00:24:25 +07:00
Frederic Bournival 1c7c76e4fb
[noovo] Add extractor 2017-04-30 00:24:19 +07:00
John Hawkinson 557194591a
[washingtonpost] Add support for embeds (closes #12699) 2017-04-29 23:07:26 +07:00
Yen Chi Hsuan 27e70a8f6c Merge pull request #12869 from Tithen-Firion/cbc-update-tests
[cbc] update test cases
2017-04-29 21:34:18 +08:00
Sergey M․ a4c81e4968
[yandexmusic:playlist] Fix extraction for python 3 (closes #12888) 2017-04-29 20:23:26 +07:00
Sergey M․ 7986c3abcd
[anvato] Improve extraction (closes #12913)
* Promote to regular shortcut based extractor
* Add mcp to access key mapping table
* Add support for embeds extraction
* Add support for anvato embeds in generic extractor
2017-04-29 19:49:04 +07:00
Yen Chi Hsuan a1ebfd4494 Merge pull request #12854 from Tithen-Firion/appletrailer-test-fix
[appletrailers] update test cases
2017-04-29 19:24:38 +08:00
Tithen-Firion 7552f96352 [openload] Add required version 2017-04-29 12:41:57 +02:00
Tithen-Firion 98f9d87381 [phantomjs] Add required version checking 2017-04-29 12:41:42 +02:00
Tithen-Firion fcace2d1ad [openload] raise not found before executing js 2017-04-29 10:30:45 +02:00
Yen Chi Hsuan d19093bd50 Merge pull request #12906 from Tithen-Firion/clean-html-fix
[utils] Fix inconsistent output of clean_html
2017-04-29 15:58:45 +08:00
Yen Chi Hsuan 24eb7c2578
[xtube] Fix extraction with non-standard JSON 'sources'
Closes #12734

Thanks @paulguy for the fix!
2017-04-29 15:55:08 +08:00
Sergey M․ e7db6759e4
[downloader/external] Properly handle live stream downloading cancellation (closes #8932) 2017-04-29 04:33:35 +07:00
Sergey M․ b364c87c42
[tvplayer] Fix extraction (closes #12908) 2017-04-29 03:46:08 +07:00
Tithen-Firion edd9221cd2 [utils] Fix inconsistent output of clean_html
`\s` in Python 2.x doesn't match unicode whitespace characters by
default
2017-04-28 17:34:27 +02:00
Sergey M․ bc8a2ea071
release 2017.04.28 2017-04-28 18:30:03 +07:00
Remita Amine 20783b8b50 [aenetworks] fix extraction for shows with single season 2017-04-28 12:04:56 +01:00
Remita Amine bf2a5555c0 [go] add support for Disney, DisneyJunior and DisneyXD show pages 2017-04-28 09:48:52 +01:00
Remita Amine fb8e8b2d16 [adobepass] use geo verification headers for all requests 2017-04-28 09:48:52 +01:00
Yen Chi Hsuan b62985a9a5
[youtube] Recognize another HTML5 player URL (#12885) 2017-04-28 16:25:04 +08:00
Yen Chi Hsuan e31fed95b4
[youtube] Recognize new locale-based player URLs (fixes #12885) 2017-04-28 15:48:30 +08:00
Tithen-Firion 3fd0f70f6a [cbslocal] Update test 2017-04-28 04:26:59 +07:00
Tithen-Firion 33c62efc32 [collegerama] Update tests 2017-04-28 04:00:49 +07:00
Tithen-Firion 6b4ddd336c [afreecatv] Fix title extraction 2017-04-28 04:00:15 +07:00
Tithen-Firion c12b4b80f8 [archiveorg] Update test 2017-04-28 03:48:32 +07:00
Tithen-Firion 064fafe932 [appleconnect] Update test 2017-04-28 03:47:25 +07:00
Tithen-Firion ac1a5b9a12 [audioboom] Update test 2017-04-28 03:36:28 +07:00
Tithen-Firion a15777491a [atresplayer] Update test 2017-04-28 03:32:25 +07:00
Tithen-Firion d8571dd6bf [bleacherreport] Update tests 2017-04-28 03:28:26 +07:00
Sergey M․ c0fa4245ce
[downloader/fragment] Remove assert for resume_len when no fragments downloaded
This may be incorrect due some header (e.g. flv header in f4m downloader)
2017-04-28 03:26:19 +07:00
Tithen-Firion 8814ae42bc [beeg] Update test 2017-04-28 03:14:11 +07:00
Tithen-Firion 0f63dc2402 [bandcamp] Update test 2017-04-28 03:13:12 +07:00
Tithen-Firion dde97ea8da [canalc2] Update test 2017-04-28 03:07:42 +07:00
Sergey M․ c89b49f743
[extractor/common] Add manifest_url for explicit group rendition formats 2017-04-28 03:00:14 +07:00
Tithen-Firion 6f4a888416 [br] Update test 2017-04-28 02:53:11 +07:00
Tithen-Firion f5edd7ae51 [clipfish] Update test 2017-04-28 02:51:30 +07:00
Tithen-Firion 96820c1c6b [cbsinteractive] extract formats with CBSIE 2017-04-27 20:23:52 +02:00
Tithen-Firion c95e2b5911 [cbc] update test cases 2017-04-27 18:07:07 +02:00
Sergey M․ ff99fe529e
Don't list master m3u8 playlists in format list (closes #12832) 2017-04-27 21:53:17 +07:00
Tithen-Firion e095109da1 [cbsinteractive] update test cases 2017-04-27 15:40:17 +02:00
Tithen-Firion d68afc5bc9 [cbsinteractive] fix extractor 2017-04-27 15:27:01 +02:00
Tithen-Firion 76c1951036 [appletrailers] update test cases 2017-04-27 10:04:21 +02:00
Lucas M e8bfe2a946 [streamable] Add support for new embedded URL schema 2017-04-26 23:39:53 +07:00
Sergey M․ 3dc8b61b7f
[arte:+7] Relax _VALID_URL (closes #12837) 2017-04-26 01:55:29 +07:00
Sergey M․ a82f41841d
release 2017.04.26 2017-04-26 00:06:12 +07:00
Sergey M․ ac9c69ace7
[extractor/common] Improve jwplayer regex 2017-04-25 23:46:05 +07:00
Sergey M․ 85f6de25e4
[downloader/fragment] Clarify current_fragment's index and mark as experimental 2017-04-25 23:33:35 +07:00
Yen Chi Hsuan 01cb57016f
[iqiyi] Fix extraction of Yule videos 2017-04-25 22:23:57 +08:00
Tithen-Firion 40e41780f1 [phantomjs] add cookie support 2017-04-25 15:12:54 +02:00
Tithen-Firion da57ebaf84 [openload] separate PhantomJS code from extractor 2017-04-25 01:06:14 +02:00
Sergey M․ 290f64dbaa
[downloader/fragment] Improve .ytdl format and start documenting 2017-04-24 23:50:20 +07:00
Sergey M․ adb4b03cd5
[downloader/fragment] Don't process ytdl file when it's not needed yet 2017-04-24 23:05:56 +07:00
Sergey M․ 0eee52f34b
Introduce --keep-fragments 2017-04-24 03:09:08 +07:00
Sergey M․ d3f0687cf7
[downloader/fragment] Use temp file for current fragment 2017-04-24 02:54:17 +07:00
Sergey M․ a4d6cf970c
[YoutubeDL] Fix output template for missing timestamp (closes #12796) 2017-04-24 00:50:39 +07:00
Sergey M․ 3019cb0c99
[extractor/common] Rephrase comment 2017-04-23 11:52:07 +07:00
Sergey M․ ddd258f922
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag 2017-04-23 11:49:57 +07:00
Sergey M․ 07ad0cf34f
[vidio] Improve and sort formats 2017-04-23 11:48:51 +07:00
Sergey M․ 9c99bef704
[extractor/common] Use float for scaled tbr 2017-04-23 11:33:49 +07:00
Remita Amine ffbc8386b9 [brightcove] match only video elements with data-video-id attribute 2017-04-22 22:26:20 +01:00
Remita Amine 4abdba643c [downloader/fragment] remove unused code 2017-04-22 18:19:47 +01:00
Remita Amine 3e0304fe6e [downloader/fragment] use the documented names for fragment progress_hooks fields 2017-04-22 16:42:24 +01:00
Yen Chi Hsuan fbf56be213
[iqiyi] Fix playlist detection (#12504) 2017-04-22 22:11:37 +08:00
Yen Chi Hsuan 54f54fcca7
[socks] Report errors elegantly when credentails are required but missing
In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)
2017-04-22 21:48:41 +08:00
Yen Chi Hsuan facfd79f9a
[azubu] Remove extractor as the site is gone (closes #12813) 2017-04-22 21:20:25 +08:00
Yen Chi Hsuan 3110bb937d
[porn91] Fix extraction (closes #12814) 2017-04-22 21:16:36 +08:00
Sergey M․ cb2520802d
[extractor/common] Improve m3u8 extraction (closes #12211)
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from #11507, #11995, #12211 and twitch vod
2017-04-22 07:01:00 +07:00
Sergey M․ f779958250
[vidzi] Fix extraction (closes #12793) 2017-04-21 23:37:06 +07:00
Remita Amine 8abc7dca39 [amp] extract error message(closes #12795) 2017-04-20 05:16:41 +01:00
Remita Amine ea0c2f219c [downloader/fragment] use a general file to store fragment download context 2017-04-19 18:53:15 +01:00
Sergey M․ 481ef51e23
[brightcove] PEP 8 2017-04-19 21:47:03 +07:00
Remita Amine 5b995f713b [utils] add support for ttml styles 2017-04-19 14:38:40 +01:00
Remita Amine 75a2485407 [fragment,hls,f4m,dash,ism] improve fragment downloading
- resume immediately
- no need to concatenate segments and decrypt them on every resume
- no need to save temp files for segments

and for hls downloader:
- no need to download keys for segments that already downloaded
2017-04-19 11:46:07 +01:00
Remita Amine 58f6ab72ed [odnoklassniki] update tests 2017-04-19 00:16:55 +01:00
Sergey M․ 2dc48df5bc
[xfileshare] Add support for gorillavid.com and daclips.com (closes #12776) 2017-04-18 23:58:37 +07:00
Sergey M․ 18848d226a
[instagram] Fix extraction (closes #12777) 2017-04-18 22:40:26 +07:00
Sergey M․ a32a9a7ef5
[extractor/common] Add support multiple getters in try_get 2017-04-18 22:39:58 +07:00
Sergey M․ bae1404893
[extractor/common] Add support for video of WebPage context in _json_ld (closes #12778) 2017-04-18 22:21:38 +07:00
Yen Chi Hsuan 06d0ad9a4e
[brightcove] Support URLs with bcpid instead of playerID
Fixes #12482
2017-04-18 23:04:22 +08:00
Sergey M․ f631b55791
[brightcove] Fix _extract_url (closes #12782) 2017-04-18 21:46:25 +07:00
Remita Amine bf1b87cd91 [common] Relax JWPlayer regex and remove duplicate urls(#12768) 2017-04-17 08:48:24 +01:00
Remita Amine 1c35b3da44 [odnoklassniki] extract m3u8 formats 2017-04-16 21:27:08 +01:00
Sergey M․ 16a09aefe3
release 2017.04.17 2017-04-17 00:46:32 +07:00
Sergey M․ ab87c26009
[extractor/generic] Add test for #12761 2017-04-17 00:36:59 +07:00
Sergey M․ 91bc57e4c5
[limelight] Add support for channels and channels lists embedded using LimelightEmbeddedPlayerFlash (#12761) 2017-04-17 00:33:47 +07:00
Sergey M․ e5d39886ec
[limelight] Improve embeds extraction (closes #12761)
* Move extraction code to extractor
* Add extraction for LimelightEmbeddedPlayerFlash embeds
* Extract multiple video
2017-04-17 00:23:16 +07:00
Sergey M․ 751c89a27d
[itv] Extract series metadata 2017-04-16 23:19:20 +07:00
Sergey M․ c2d7d76efd
[itv] Fix rtmp formats (#12759) 2017-04-16 23:15:24 +07:00
Sergey M․ f67177cae8
[itv] Use native hls 2017-04-16 21:52:45 +07:00
Sergey M․ 5935ef3c5d
[itv] Lower preference for rtmp formats (closes #12759) 2017-04-16 21:52:07 +07:00
Tithen-Firion 47e0cef46e [openload] rewrite extractor 2017-04-16 00:34:34 +02:00
remitamine 72950c4dce Merge pull request #12752 from triple-j/go90_improvements_pull_request
[go90] Improve extraction
2017-04-15 23:48:13 +02:00
Jeremie J. Jarosh 334f41e0d8 [go90] Improve extraction
- add metadata for 'series', 'episode', 'season', 'season_id',
  'season_number', and 'episode_number'
- integrate series title into the title
- extract subtitles  (fallback to `vtt` if the subtitle file type
  detection fails as that is the most likely extension)
2017-04-15 16:32:00 -05:00
Sergey M․ 022250a594
release 2017.04.16 2017-04-16 01:49:02 +07:00
Sergey M․ d35dc344af
[YoutubeDL] Apply expand_path after output template substitution
os.path.expandvars translates '%%' into '%' making output template invalid.
Before: '%%(ext)s' -(expand path)-> '%(ext)s' -(outtmpl subst.)-> 'mp4'
After: '%%(ext)s' -(outtmpl subst.)-> '%(ext)s' -(expand path)-> '%(ext)s'
2017-04-16 01:39:07 +07:00
Sergey M․ 0563f7ac6e
[YoutubeDL] Propagate overridden metadata to IE results of type url (closes #11163) 2017-04-16 00:57:36 +07:00
Sergey M․ 413c1f8e2f
[extractor/generic] Extract RSS entries as url_transparent (#11163) 2017-04-16 00:57:32 +07:00
Sergey M․ 8068296276
[streamango] Improve extraction (closes #12643) 2017-04-15 21:50:51 +07:00
Marvin Ewald 4db79fa1bc
[streamango] Add extractor 2017-04-15 21:50:46 +07:00
Sergey M․ b2a19e3829
[wsj] Improve and modernize (closes #12558) 2017-04-15 20:59:05 +07:00
John Hawkinson 3266d08af2
[wsj:article] Add extractor 2017-04-15 20:58:57 +07:00
Sergey M․ 0254f93b08
[brightcove] Validate ambiguous embeds' URLs (closes #9163, closes #12005, closes #12178, closes #12480) 2017-04-15 20:31:49 +07:00
John Hawkinson 40158f55c9
[brightcove] Relax video tag embeds extraction
BrightcoveNewIE.extract_urls(): Handle player data when it is all in
attributes of the <video> tag, and also the id is
data-brightcove-video-id not data-video-id.

Add test to generic extractor, note HEAD gives 404, no checksum computed(?).
2017-04-15 20:31:43 +07:00
Sergey M․ 3dfceb286c
[udemy] Add support for react rendition (closes #12744) 2017-04-15 03:26:19 +07:00
Sergey M․ 57e2cb6c3a
[curiositystream] PEP 8 2017-04-15 02:33:26 +07:00
Sergey M․ 6f1b2374af
[canalplus] PEP 8 2017-04-15 02:33:12 +07:00
Sergey M․ d24bd4ffdb
release 2017.04.15 2017-04-15 01:39:33 +07:00
Sergey M․ 34c3bbe1bd
[youku] Keep old fileid extraction code as fallback (#12741) 2017-04-15 01:28:02 +07:00
xuhaomin e5106ba402 [youku] Fix fileid extraction 2017-04-14 13:23:02 -05:00
Sergey M․ 38d2f8325f
release 2017.04.14 2017-04-14 00:31:49 +07:00
Sergey M․ 95728fda70
[aenetworks] Add support for specials (closes #12723) 2017-04-13 23:39:55 +07:00
Remita Amine 3f7409f745 [hbo] extract m3u8 formats 2017-04-13 12:28:22 +01:00
Remita Amine b2fff30817 [go90] Add new extractor(closes #10127) 2017-04-13 12:28:22 +01:00
Remita Amine f59746372a [downloader/hls] add basic support for EXT-X-BYTERANGE tag(#10955) 2017-04-13 12:28:22 +01:00
Yen Chi Hsuan 34d98cc411
[tv2hu] Fix invalid escape sequence on Py3.6 2017-04-13 16:52:52 +08:00
Remita Amine 40fcba5edb improve coding style 2017-04-12 20:38:43 +01:00
Remita Amine e4d74e2778 [tv2hu] improve extraction 2017-04-12 19:44:32 +01:00
Vukkk 3ef1d0c733 [tv2hu] Add new extractor 2017-04-12 19:36:02 +01:00
Remita Amine 0ee79a378a [generic] exclude urls with xml ext from valid video urls(closes #10768)(closes #11654) 2017-04-12 16:22:08 +01:00
Remita Amine 79a51069e5 [adobepass] improve comcast and verison login code(closes #10803) 2017-04-12 15:19:58 +01:00
Daniel Twardowski a9a346535b [adobepass] Add Verizon support (#10803) 2017-04-12 01:18:57 -04:00
Remita Amine 89beedd31f [youtube] improve m3u8 format extraction 2017-04-11 21:55:59 +01:00
Sergey M․ e109f1ff43
[afreecatv] Fix extraction for videos with different key layout (closes #12718) 2017-04-12 02:17:34 +07:00
Sergey M․ d23028a8fb
[youtube] Remove explicit preference for audio-only and video-only formats
In order not to break sorting when new formats appear
2017-04-11 22:41:48 +07:00
Sergey M․ 6214611a4a
[canalplus] Bypass geo restriction 2017-04-11 22:30:15 +07:00
Sergey M․ 1730878167
release 2017.04.11 2017-04-11 02:17:53 +07:00
Sergey M․ 6b9466de2f
[afreecatv] Fix extraction (closes #12706) 2017-04-11 02:05:53 +07:00
John Hawkinson 61568e50cf [generic] Add support for <object> youtube embeds (closes #12637) 2017-04-11 00:04:32 +07:00
Sergey M․ 6240925b40
[bbccouk] Treat bitrate as audio+video bitrate in media selector 2017-04-10 22:56:22 +07:00
Sergey M․ 964744af95
[bbccouk] Skip unrecognized formats in media selector (#12701) 2017-04-10 22:53:51 +07:00
Sergey M․ 1af959ef9f
[bbccouk] Add support for https protocol in media selector (closes #12701) 2017-04-10 22:53:06 +07:00
Remita Amine a206ef62df [curiositystream] fix extraction(closes #12638) 2017-04-10 13:50:08 +01:00
Remita Amine 3f2ce6896a [adn] update subtitle decryption key 2017-04-09 12:33:29 +01:00
Sergey M․ a6f7263cf4
[chaturbate] Fix extraction (closes #12665) 2017-04-09 01:39:40 +07:00
Sergey M․ 4372436504
release 2017.04.09 2017-04-09 00:01:28 +07:00
Sergey M․ 41b263ac8a
[canvas] Add IE_DESC (closes #12478) 2017-04-08 22:45:45 +07:00
Sergey M․ ca8fca9d9d
[vrt] Add IE_DESC (closes #12477) 2017-04-08 22:44:31 +07:00
midas02 e129fa0846 [vier] Add IE_DESC 2017-04-08 22:43:29 +07:00
Sergey M․ 2bd875edfe
[medici] Add extractor (closes #3406) 2017-04-08 22:38:37 +07:00
Steven Maude 95152630db [rbmaradio] Add support for redbullradio.com URLs 2017-04-08 21:39:07 +07:00
Sergey M․ 04e431cf97
[npo:live] Improve (closes #12555) 2017-04-08 21:31:22 +07:00
Aldo Gunsing 1591ba258a
[npo:live] Add support for default url 2017-04-08 21:30:38 +07:00
Sergey M․ 29c6726646
[mixcloud] Fix view count extraction and modernize 2017-04-08 21:11:08 +07:00
Sergey M․ a66e25859a
[mixcloud:playlist] Relax title extraction and fix description extraction (closes #12582) 2017-04-08 21:04:09 +07:00
Kfir Breger c93c0fc2fd
[mixcloud:playlist] Fix title extraction 2017-04-08 20:47:07 +07:00
Sergey M․ 90e3f18fc1
[thesun] Extract playlists (closes #11298, closes #12674) 2017-04-08 20:08:31 +07:00
Entropy 5f3e0b69ef
[TheSun] Add new extractor 2017-04-08 19:54:04 +07:00
Sergey M․ 28b674ca23
[ceskateleveize:porady] Add extractor (closes #7411, closes #12645) 2017-04-08 19:46:42 +07:00
Sergey M․ e18f1da97a
[ceskateleveize] Improve extraction and remove URL replacement hacks 2017-04-08 19:41:14 +07:00
Sergey M․ 78280352ca
[kaltura] Cleanup regexes from redundant escaping 2017-04-08 16:48:27 +07:00
John Hawkinson a01825a541 [kaltura] Add support for iframe embeds 2017-04-08 16:40:57 +07:00