13279 commits

Author	SHA1	Message	Date
Sergey M․	a3c3a1e128	[http] Rework HTTP downloader ... * Simplify code and split into separate routines to facilitate maintaining * Make retry mechanism work on errors during actual download not only during connection establishment phase * Retry on ECONNRESET and ETIMEDOUT during reading data from network * Retry on content too short and various timeout errors * Show error description on retry * Closes #506, closes #809, closes #2849, closes #4240, closes #6023, closes #8625, closes #9483	2017-08-27 02:22:30 +07:00
Sergey M․	085d9dd9be	[rai] Fix audio formats extraction (closes #14024)	2017-08-26 22:02:49 +07:00
Vijay Singh	151978f38a	[mixcloud] Fix extraction (closes #14020)	2017-08-26 19:32:57 +07:00
Sergey M․	c7121fa7b8	[youtube] Fix controversy videos extraction (closes #14027, closes #14029)	2017-08-26 15:38:38 +07:00
Vijay Singh	745968bc72	[mixcloud] Fix extraction (closes #14015)	2017-08-24 22:28:44 +07:00
Sergey M․	df235dbba8	release 2017.08.23	2017-08-23 23:23:13 +07:00
Sergey M․	5bae33485c	[toutv] PEP 8	2017-08-23 22:50:00 +07:00
Sergey M․	0830f3e048	[cbc:watch] Bypass geo-restriction (closes #13993)	2017-08-23 22:45:45 +07:00
Sergey M․	8d7a24aff6	[toutv] Relax DRM check (closes #13994)	2017-08-23 22:28:09 +07:00
Sergey M․	37d9af306a	[googledrive] Simplify and carry long lines (#13638)	2017-08-23 00:33:53 +07:00
Sergey M․	e01c3d2ef7	[extractor/common] Introduce _parse_xml	2017-08-23 00:32:41 +07:00
Parmjit Virk	05915e379a	[googledrive] Add support for subtitles (fixes #13619)	2017-08-22 23:48:59 +07:00
Sergey M․	8d9c2a681a	[pornhub] Relax uploader regex (closes #13906, closes #13975)	2017-08-21 23:06:27 +07:00
Luca Steeb	8239c6791a	[bandcamp:album] Extract track titles	2017-08-20 23:32:33 +07:00
Sergey M․	b359e977b9	[extractor/common] Make HLS and DASH extraction non fatal in _parse_html5_media_entries (closes #13970)	2017-08-20 14:16:58 +07:00
Sergey M․	d3d45e0a45	[bbccouk] Add support for events URLs (closes #13893)	2017-08-19 23:54:15 +07:00
Yen Chi Hsuan	381ad4f309	[liveleak] Support multi-video pages (closes #6542)	2017-08-19 22:48:00 +08:00
Yen Chi Hsuan	09747ba766	[liveleak] Support another liveleak embedding pattern (closes #13336)	2017-08-19 22:28:13 +08:00
Yen Chi Hsuan	f8f18f332f	[cda] Fix extraction (closes #13935)	2017-08-19 21:44:47 +08:00
Yen Chi Hsuan	95f3f7c20a	[utils] Fix unescapeHTML for misformed string like "&a"" (#13935)	2017-08-19 21:40:53 +08:00
Sergey M․	f5469da9e6	[laola1tv] Add support for tv.ittf.com (closes #13965)	2017-08-19 19:48:20 +07:00
Sergey M․	d14d9d8903	[mixcloud] Fix extraction (closes #13958)	2017-08-18 23:31:42 +07:00
Sergey M․	ea004d34f8	release 2017.08.18	2017-08-18 01:05:27 +07:00
Sergey M․	4a91910365	[qqmusic:toplist] PEP 8	2017-08-18 01:00:07 +07:00
Sergey M․	c0892b2b46	[arte] Detect unavailable videos (closes #13945)	2017-08-18 00:58:23 +07:00
Sergey M․	a5ac0c4755	[YoutubeDL] Sanitize byte string format URLs (#13951)	2017-08-17 23:59:12 +07:00
Sergey M․	5551d7714d	[generic] Convert redirect URLs to unicode strings (closes #13951)	2017-08-17 23:58:01 +07:00
Sergey M․	5f5c7b92dd	[udemy] Fix paid course detection (#13943)	2017-08-17 23:14:46 +07:00
Sergey M․	93d0583e34	[pluralsight] Use RPC API for course extraction (closes #13937)	2017-08-17 22:45:40 +07:00
Genki Sky	bfabd17b33	Add new extractor	2017-08-17 16:56:06 +08:00
Yen Chi Hsuan	25a6e769a1	[qqmusic] Fix tests and cleanup	2017-08-17 16:39:57 +08:00
Yen Chi Hsuan	d22b67f356	Merge pull request #13805 from gam2046/master ... Fix QQ Music url changed	2017-08-17 16:11:35 +08:00
Sergey M․	a1aa659662	[periscope] Renew HLS extraction (closes #13917)	2017-08-16 23:03:42 +07:00
Sergey M․	4850478543	[extractor/common] Add support for float durations in _parse_mpd_formats (closes #13919)	2017-08-15 23:58:00 +07:00
forDream	134d85a7bd	[qqmusic] review	2017-08-15 13:14:35 +08:00
forDream	5c037c0d1f	[qqmusic]support QQMusicSingerIE	2017-08-15 13:14:35 +08:00
forDream	5d1bd3b907	[qqmusic]update valid url	2017-08-15 13:14:34 +08:00
forDream	19ada898dc	fix QQ Music Url changed	2017-08-15 13:14:34 +08:00
Sergey M․	da20951a57	[mixcloud] Extract decrypt key	2017-08-14 22:39:05 +07:00
Sergey M․	16393d6535	release 2017.08.13	2017-08-13 08:58:30 +07:00
Sergey M․	475bcb225f	[pornhub:playlistbase] Skip videos from drop-down menu for all playlists (closes #12819, closes #13902)	2017-08-13 07:53:02 +07:00
Sergey M․	b3c6515365	[fourtube] Add support for other sites (closes #6022, closes #7859, closes #13901)	2017-08-13 07:23:29 +07:00
Sergey M․	eb02940cc7	[generic] Add test for #13895	2017-08-13 01:11:27 +07:00
Sergey M․	4ef9152428	[limelight] Improve embeds detection (closes #13895)	2017-08-13 00:58:39 +07:00
Sergey M․	0c43a481b9	[reddit] Add extractors (closes #13847)	2017-08-12 23:43:51 +07:00
Sergey M․	868f79db41	[extractor/common] Fix _media_formats	2017-08-12 19:24:26 +07:00
Sergey M․	70851a95c3	[aparat] Extract all formats (closes #13887)	2017-08-12 17:18:23 +07:00
Sergey M․	e74e3b63e3	[YoutubeDL] Make sure format id is not empty	2017-08-12 17:14:11 +07:00
Sergey M․	ac8491fcca	[extractor/common] Make _family_friendly_search optional	2017-08-12 17:11:35 +07:00
Sergey M․	82889d4ae5	[extractor/common] Respect source's type attribute for HTML5 media (closes #13892)	2017-08-12 16:48:11 +07:00
Sergey M․	92a5c41532	[mixcloud] Fix play info decryption (closes #13885)	2017-08-12 16:30:50 +07:00
Sergey M․	1663bd6e1c	[generic] Replace vzaar embed test	2017-08-11 22:02:00 +07:00
tetra-eder	41918eaa5c	[generic] Add support for vzaar embeds	2017-08-11 22:00:39 +07:00
Sergey M․	6ed99754bb	release 2017.08.09	2017-08-09 23:52:22 +07:00
Sergey M․	baba5f4d1d	[xxxymovies] Fix title extraction (closes #13868)	2017-08-09 23:46:49 +07:00
Sergey M․	dee04d24a4	[nick] Add support for nick.com.pl (closes #13860)	2017-08-09 23:12:02 +07:00
Sergey M․	5b3ddadcc3	[mixcloud] Fix play info decryption (closes #13867)	2017-08-09 22:55:13 +07:00
Sergey M․	5b232f46dc	[utils] Skip missing params in cli_bool_option (closes #13865)	2017-08-09 22:28:19 +07:00
Alex Seiler	4bf22f7a10	[20min] Fix embeds extraction	2017-08-08 05:41:38 +07:00
Sergey M․	15d1e8a23d	[dplayit] Fix extraction (closes #13851)	2017-08-07 22:43:42 +07:00
Yen Chi Hsuan	ee6a611665	[niconico] Support videos with multiple formats (closes #13522)	2017-08-07 00:19:46 +08:00
Yen Chi Hsuan	463e7216c8	[niconico] Support HTML5-only videos (closes #13806)	2017-08-06 23:07:28 +08:00
Sergey M․	903a183b6a	release 2017.08.06	2017-08-06 09:05:36 +07:00
Sergey M․	fac188c695	[pluralsight] Fix format selection	2017-08-06 08:44:28 +07:00
Sergey M․	16afce174e	[mpora] Remove extractor (closes #13826)	2017-08-06 08:18:16 +07:00
Sergey M․	e2b4808fd8	[voot] Improve extraction (#10255, closes #11814)	2017-08-06 08:05:29 +07:00
Ashutosh Chaudhary	daaaf5f594	[voot] Add extractor	2017-08-06 08:05:24 +07:00
Sergey M․	f172c86dcd	[vlive:channel] Limit number of videos per page to 100 (closes #13830)	2017-08-05 21:17:55 +07:00
Sergey M․	1d5472290f	[podomatic] Extend _VALID_URL (closes #13827)	2017-08-05 08:28:12 +07:00
Sergey M․	c983cc3b71	[cinchcast] Extend _VALID_URL	2017-08-05 08:17:01 +07:00
Sergey M․	1141e9104b	Use relative paths for DASH fragments (closes #12990) ... 10x reduced JSON size refs #13810	2017-08-05 07:40:29 +07:00
Sergey M․	8519b88f67	[yandexdisk] Relax _VALID_URL (closes #13824)	2017-08-05 00:59:07 +07:00
Sergey M․	bbbe1cebfc	[mlb] Update test (closes #13777)	2017-08-05 00:09:36 +07:00
Sergey M․	f31fd0693b	[vidme] Extract DASH and HLS formats	2017-08-05 00:00:21 +07:00
Sergey M․	799802f368	[teamfour] Remove extractor (closes #13782) ... Now covered with generic extractor	2017-08-04 23:54:28 +07:00
Sergey M․	b3b5870cba	[pornhd] Fix extraction (closes #13783)	2017-08-04 23:51:03 +07:00
Sergey M․	57a38a38c3	[udemy] Fix subtitles extraction (closes #13812)	2017-08-04 23:45:13 +07:00
Matt Crupi	11a6793f80	[mlb] Extend _VALID_URL (closes #13740)	2017-08-04 22:46:54 +07:00
Sergey M․	183062a4ab	[pbs] Add support for new URL schema (closes #13801)	2017-08-03 23:19:59 +07:00
Tithen-Firion	feee8d32e4	[phantomjs] add exe version to debug info	2017-08-03 14:17:25 +02:00
Sergey M․	9118c9f18a	[nrktv] Update API host (closes #13796)	2017-08-01 05:21:00 +07:00
Sergey M․	5c9ea67bc0	release 2017.07.30.1	2017-07-30 20:47:31 +07:00
Sergey M․	8b9f50d7cb	[watchbox] Add extractor (#13739)	2017-07-30 19:09:44 +07:00
Sergey M․	0ed4758023	[clipfish] Remove extractor	2017-07-30 19:08:44 +07:00
Sergey M․	a0a477b885	[youjizz] Fix extraction (closes #13744)	2017-07-30 15:48:22 +07:00
Grzegorz Ruciński	198d4cb40c	[generic] Add support for another ooyala embed pattern (closes #13727)	2017-07-30 01:30:04 +07:00
Sergey M․	ca127ab2c1	[ard] Add support for lives (closes #13771)	2017-07-29 23:07:28 +07:00
Sergey M․	e445850e69	[soundcloud] Update client id	2017-07-29 18:45:57 +07:00
Sergey M․	836ef26486	[soundcloud:trackstation] Add extractor (closes #13733)	2017-07-29 18:41:42 +07:00
Sergey M․	c04017519d	[svtplay] Use geo verification proxy for API request	2017-07-29 15:30:53 +07:00
Sergey M․	2a7a823211	[svtplay] Update API URL (closes #13767)	2017-07-29 15:25:32 +07:00
Sergey M․	95908ce453	[extractor/generic] PEP 8	2017-07-29 15:13:12 +07:00
Sergey M․	cbbe66635f	[yandexdisk] Add extractor (closes #13755)	2017-07-29 15:10:19 +07:00
Sergey M․	c5a49ff084	[downloader/hls] Use redirect URL as manifest base (#13755)	2017-07-29 15:02:41 +07:00
Philipp Hagemeister	24e966e8da	[megaphone] Add extractor	2017-07-28 12:13:19 +02:00
Sergey M․	9682666bda	[amcnetworks] Make rating optional (closes #12453)	2017-07-27 02:04:51 +07:00
Sergey M․	f9c48d895b	[cloudy] Fix extraction (closes #13737)	2017-07-26 23:12:43 +07:00
Sergey M․	c99d6890cb	[nickru] Add extractor	2017-07-23 21:02:06 +07:00
Sergey M․	70bfab0e9a	[mtv] Improve thumbnal extraction	2017-07-23 21:02:06 +07:00
nyuszika7h	f0e31e32c9	[nick] Automate geo-restriction bypass (#13711)	2017-07-23 20:40:04 +07:00
Yen Chi Hsuan	e3ce912c3d	[niconico] improve error reporting (#13696)	2017-07-23 16:25:30 +08:00
Yen Chi Hsuan	905d18a7aa	[options] Correctly hide login info from debug outputs (#13696) ... Iterate over opts instead of PRIVATE_OPTS for both performance and correctness	2017-07-23 16:22:14 +08:00
Sergey M․	0db492c02a	release 2017.07.23	2017-07-23 01:09:09 +07:00
Sergey M․	71dde5eecf	[itv] Fix production id extraction (closes #13671)	2017-07-23 00:59:07 +07:00
Sergey M․	935d6c20c0	[vidio] Make duration non fatal and fix typo	2017-07-23 00:44:50 +07:00
Sergey M․	e0f1fb0a27	[mtv] Skip missing video parts (closes #13690)	2017-07-23 00:25:23 +07:00
Sergey M․	0017d9ad6d	[YoutubeDL] Improve default format specification (closes #13704)	2017-07-23 00:12:01 +07:00
Sergey M․	327c8364f1	[sportbox:embed] Fix extraction	2017-07-22 21:35:14 +07:00
dubber0	359aa2fdd1	[npo] Add support for npo3.nl URLs	2017-07-22 19:15:55 +07:00
Sergey M․	f76c02c87b	[dramafever] Fix tests	2017-07-22 11:41:40 +07:00
Sergey M․	7d9a1db111	[dramafever] Remove video id from title (closes #13699)	2017-07-22 11:40:46 +07:00
Sergey M․	0396806f67	[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent ... All these meta fields must be borrowed from final extractor that actually performs extraction. This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.	2017-07-21 00:13:32 +07:00
Sergey M․	dc6520aa3d	[egghead:lesson] Add extractor (#6635)	2017-07-20 23:22:36 +07:00
Sergey M․	c653326a14	[funnyordie] Extract more metadata (closes #13677)	2017-07-20 22:50:56 +07:00
Yen Chi Hsuan	3fcf346ac1	[youku:show] Refine playlist extraction ... Handle playlists that the initial page is not the first page	2017-07-20 23:20:46 +08:00
Yen Chi Hsuan	fa63cf6c23	[youku:show] Fix playlist extraction (closes #13248)	2017-07-20 22:57:51 +08:00
Yen Chi Hsuan	85f5a74b6c	[tbs] Mark as broken and skip invalid tests	2017-07-20 21:19:09 +08:00
Yen Chi Hsuan	d20b1c6725	[dispeak] Recognize sevt subdomain (closes #13276)	2017-07-20 18:14:14 +08:00
Sergey M․	bb176df3bb	[spiegel:article] Move test	2017-07-17 22:19:40 +07:00
Sergey M․	83d00044c1	[adn] Improve error reporting (#13663)	2017-07-16 20:50:32 +07:00
Sergey M․	7abed4e06c	[crunchyroll] Relax series and season regex (closes #13659)	2017-07-16 12:40:45 +07:00
Sergey M․	13eb526f11	[nexx:embed] PEP 8	2017-07-16 05:23:19 +07:00
Sergey M․	00d06e3cfc	[spiegel:article] Add support for nexx iframe embeds (closes #13029)	2017-07-16 04:38:20 +07:00
Sergey M․	749ca5eced	[extractor/common] Fix playlist_from_matches	2017-07-16 04:33:14 +07:00
Sergey M․	3f59b0154a	[nexx:embed] Add extractor for iframe embeds	2017-07-16 04:32:37 +07:00
Sergey M․	089b97cfee	[nexx] Improve JS embed extraction	2017-07-16 04:30:48 +07:00
Sergey M․	decf86044d	[pearvideo] Improve (closes #13031)	2017-07-16 03:06:04 +07:00
troywith77	94b817edeb	[pearvideo] Add extractor	2017-07-16 03:02:31 +07:00
Sergey M․	cea931a9e5	release 2017.07.15	2017-07-15 07:36:05 +07:00
Sergey M․	961ea474b6	[YoutubeDL] PEP 8	2017-07-15 07:02:57 +07:00
Sergey M․	ea3f20494f	[youtube] PEP 8	2017-07-15 07:02:57 +07:00
Sergey M․	c7604d79e9	[spiegeltv] Delegate extraction to nexx (closes #13159)	2017-07-15 07:02:57 +07:00
Sergey M․	4e826cd9ae	[nexx] Add extractor (closes #10807, closes #13465)	2017-07-15 07:02:57 +07:00
Robin Neatherway	2583c0b54e	Fix bugs caused by typos	2017-07-14 23:08:32 +07:00
Sergey M․	7d02dcfaa2	[youtube] Don't capture YouTube Red ad for creator meta field (closes #13621)	2017-07-14 22:37:04 +07:00
satunnainen	00dbdfc1f7	[slideshare] Fix extraction	2017-07-14 22:11:07 +07:00
rrooij	f354d84807	[5tv] Add another video URL pattern (closes #13354)	2017-07-14 22:10:17 +07:00
Sergey M․	15da37c7dc	[YoutubeDL] Don't expand env variables in meta fields (closes #13637)	2017-07-14 00:42:12 +07:00
Sergey M․	9a0942ad55	[drtv] Make HLS and HDS extraction non fatal	2017-07-11 22:59:56 +07:00
Sergey M․	f2bb33a986	[ted] Fix subtitles extraction (closes #13628, closes #13629)	2017-07-11 21:36:45 +07:00
Yen Chi Hsuan	3615bfe1b4	[twitter] Fix remaining tests	2017-07-11 16:46:37 +08:00
Yen Chi Hsuan	e8f20ffa03	[vine] Make sure the title won't be empty ... And fix a relevant TwitterCard test case	2017-07-11 16:05:15 +08:00
Yen Chi Hsuan	9be31e771c	[twitter] Support HLS streams in vmap URLs	2017-07-11 15:48:48 +08:00
Yen Chi Hsuan	7f176ac477	[periscope] Support pscp.tv URLs in embedded frames ... And fix a relevant twitter test	2017-07-11 15:35:19 +08:00
Yen Chi Hsuan	2edfd745df	[twitter] Extract mp4 urls via mobile API (closes #12726)	2017-07-11 15:19:36 +08:00
Yen Chi Hsuan	bb13949197	[niconico] Check login errors (#12486)	2017-07-11 15:03:11 +08:00
Yen Chi Hsuan	c3c94ca4a4	[giantbomb] Extract m3u8 formats (closes #13626)	2017-07-10 21:34:27 +08:00
Sergey M․	e3cd1fcdd1	[vlive:playlist] Relax and simplify	2017-07-10 04:32:24 +07:00
coreynicholson	b71c18b434	[vlive:playlist] Add extractor	2017-07-10 04:24:04 +07:00
Sergey M․	7bf539edcc	[eagleplatform] Fix test	2017-07-10 00:14:41 +07:00