Commit graph

10813 commits

Author SHA1 Message Date
Remita Amine 1306f5ed72 [mychannels] add support for mychannels.com(closes #15334) 2018-05-16 19:11:48 +01:00
Remita Amine 58a68d8fda [moniker] Remove extractor(closes #15336) 2018-05-16 18:44:33 +01:00
Remita Amine eea2fafcf5 [pbs] fix embed data extraction(fixes #16474) 2018-05-16 18:34:25 +01:00
Remita Amine 6843ac5b13 add support for paramountnetwork.com and bellator.com(fixes #15418) 2018-05-16 17:49:35 +01:00
Remita Amine 54fc90aabf [youtube] fix hd720 format position 2018-05-16 16:24:44 +01:00
Remita Amine 997530d9d4 [dailymotion] remove fragment part from m3u8 urls(closes #8915) 2018-05-16 12:04:24 +01:00
Remita Amine fe3a60f040 [dreisat] improve extraction(closes #15350)
- extract all formats
- extract more format metadata extraction
- improve format sorting
- use hls native downloader
- detect geo-restriction
- bypass geo-restriction
2018-05-16 11:30:29 +01:00
Remita Amine 7f34984e81 [dtube] Add new extractor(closes #15201) 2018-05-16 09:35:47 +01:00
Sergey M․ c63ca0eef8
[youtube] Improve format filesize extraction (#16453) 2018-05-14 23:27:56 +07:00
Sergey M․ 84a9fef899
[youtube] Make uploader extraction non fatal (#16444) 2018-05-13 22:49:01 +07:00
Remita Amine 4c76aa0666 [youtube] fix extraction for embed restricted live streams(fixes #16433) 2018-05-13 13:20:16 +01:00
Remita Amine 90b633f86b [nbc] improve info extraction(fixes #16440) 2018-05-13 11:31:41 +01:00
Sergey M․ 07acdc5afc
[twitch:clips] Sort formats 2018-05-12 12:08:54 +07:00
Sergey M․ 49fa7de301
[twitch:clips] Fix extraction (closes #16429) 2018-05-11 23:21:02 +07:00
llyyr dbd5c502ea [redditr] Relax _VALID_URL (closes #16426) 2018-05-10 23:17:23 +07:00
Sergey M․ bc5e4aa57e
[mixcloud] Bypass throttling for HTTP formats (#12579, #16424) 2018-05-10 22:22:26 +07:00
Sergey M․ 1344d3e169
[nickbr] Relax _VALID_URL (#13230) 2018-05-10 22:01:13 +07:00
Remita Amine ff8889cd4d [teamcoco] fix extraction(closes #16374) 2018-05-10 08:19:56 +01:00
Sergey M․ 2fbd86352e
[udemy] Extract asset captions 2018-05-08 22:57:01 +07:00
Sergey M․ 0ce76801e8
[udemy] Extract stream URLs (closes #16372) 2018-05-08 22:33:35 +07:00
Sergey M․ 789b7774a7
[businessinsider] Add extractor (closes #16387, closes #16388, closes #16389) 2018-05-06 21:58:55 +07:00
Sergey M․ 660a230b2d
[cloudflarestream] Add support for cloudflare streams (closes #16375) 2018-05-05 01:21:52 +07:00
Sergey M․ a90a6b54ee
[watchbox] Fix extraction (closes #16356) 2018-05-02 20:43:34 +07:00
Remita Amine 3cc0d0b829 [discovery] extract Affiliate/Anonymous Auth Token from cookies(closes #14954) 2018-05-02 09:32:53 +01:00
Sergey M․ ea1f5e5dbd
[itv:btcc] Add extractor (closes #16139) 2018-05-02 07:21:24 +07:00
Sergey M․ 5f95927a62
Improve geo bypass mechanism
* Introduce geo bypass context
* Add ability to bypass based on IP blocks in CIDR notation
* Introduce --geo-bypass-ip-block
2018-05-02 07:20:59 +07:00
Sergey M․ a93ce61bd5
[tunein] Use live title for live streams (closes #16347) 2018-05-02 01:29:44 +07:00
Sergey M․ c18142da6e
[itv] Improve extraction (closes #16253) 2018-05-01 22:48:08 +07:00
Sergey M․ c21692fa94
[kaltura] Improve iframe embeds detection (closes #16337) 2018-05-01 03:09:04 +07:00
Sergey M․ 8513963468
[udemy] Extract outputs renditions (closes #16289, closes #16291, closes #16320, closes #16321, closes #16334, closes #16335) 2018-05-01 02:15:43 +07:00
Sergey M․ 67ca1a8ef7
[zattoo] Improve and simplify (closes #14676) 2018-05-01 01:50:30 +07:00
Alex Seiler 4a73354586
[zattoo] Add extractor (closes #14668) 2018-05-01 01:50:07 +07:00
Sergey M․ 796bf9de45
[yandexmusic] Convert release_year to int 2018-04-29 22:56:07 +07:00
Sergey M․ e5eadfa82f
[udemy,xiami,yandexmusic] Override _download_webpage_handle instead of _download_webpage 2018-04-29 22:54:52 +07:00
Niklas Haas 30226342ab [youtube] Correctly disable polymer on all requests
Rather than just the one that use the _download_webpage helper. The need
for this was made apparent by 0fe7783e, which refactored
_download_json in a way that completely avoids the use of
_download_webpage, thus breaking youtube.

Fixes #16323
2018-04-29 22:35:16 +07:00
Bastian de Groot 01aec84880 [generic] Prefer enclosures over links in RSS feeds 2018-04-29 22:14:37 +07:00
Meneth32 12b0d4e0e1 [redditr] Add support for old.reddit.com URLs 2018-04-29 21:59:40 +07:00
Sergey M․ 106c8c3edb
[nrktv] Update API host (closes #16324) 2018-04-29 19:04:40 +07:00
Sergey M․ 7dd6ab4a47
[imdb] Extract all formats (closes #16249) 2018-04-28 04:51:39 +07:00
Sergey M․ ae1c585cee
[vimeo] Extract JSON LD (closes #16295) 2018-04-28 02:51:18 +07:00
Sergey M․ e7e4a6e0f9
[extractor/common] Extract interaction statistic 2018-04-28 02:48:03 +07:00
Sergey M․ 6cc622327f
[utils] Introduce merge_dicts 2018-04-28 02:47:17 +07:00
Sergey M․ 0fe7783ece
[extractor/common] Add _download_json_handle 2018-04-28 01:59:15 +07:00
Sergey M․ c84eae4f66
[funk:channel] Improve extraction (closes #16285) 2018-04-27 03:45:52 +07:00
Alexandre Macabies 76030543cd [openload] Recognize IPv6 stream URLs (closes #16137) 2018-04-25 00:49:30 +07:00
Sergey M․ 0ff51adae6
[twitch] Extract is_live according to status (closes #16259) 2018-04-24 23:55:06 +07:00
Sergey M․ 99036a1298
[pornflip] Relax _VALID_URL (closes #16258) 2018-04-23 04:03:11 +07:00
Sergey M․ 171625469a
[etonline] Remove extractor (closes #16256)
Covered by generic extractor
2018-04-23 03:17:34 +07:00
Sergey M․ 2441c1aab1
[breakcom] Fix extraction (closes #16254) 2018-04-23 00:16:52 +07:00
Sergey M․ 70d35d166c
[youtube] Add ability to authenticate with cookies 2018-04-22 06:08:05 +07:00
Sergey M․ 3853309fe2
[youtube:feed] Implement lazy playlist extraction (closes #10184) 2018-04-22 06:07:32 +07:00
Sergey M․ 6cdaaf7031
[svt] Improve (closes #15809) 2018-04-22 05:34:03 +07:00
0x9fff00 488ff2dd3a
[svt] Add support for TV channel live streams (Closes #15279) 2018-04-22 05:33:40 +07:00
Sergey M․ 353f0bde78
[cbssports] PEP 8 2018-04-22 04:57:22 +07:00
Sergey M․ 040c6296bb
[ccma] Fix video extraction (closes #15931) 2018-04-22 04:55:35 +07:00
Sergey M․ a693386df1
[rentv] Improve extraction (closes #15227) 2018-04-21 23:22:30 +07:00
einstein95 4b8588fe02
[rentv] Fix extraction 2018-04-21 23:22:25 +07:00
Sergey M․ d65a48a0ef
[nick] Add support for nickjr.nl (closes #16230) 2018-04-20 23:12:13 +07:00
Sergey M․ c194200277
[mofosex] Fix test 2018-04-19 22:38:31 +07:00
Sergey M․ d317973284
[extremetube] Fix metadata extraction 2018-04-19 22:36:33 +07:00
Parmjit Virk 1792bc3a06 [keezmovies] Add support for generic embeds (closes #16134) 2018-04-19 22:25:51 +07:00
Remita Amine d86c5167ae [nexx] extract new azure urls(closes #16223) 2018-04-19 15:48:03 +01:00
Remita Amine b004d9bbf1 [cbssports] fix extraction(fixes #16217) 2018-04-19 15:08:17 +01:00
Sergey M․ 9b3036bd2e
[instagram:user] Fix extraction (closes #16119) 2018-04-18 10:12:24 +07:00
Sergey M․ e30991f920
[kaltura] Improve embeds detection (closes #16201) 2018-04-18 01:26:15 +07:00
Sergey M․ 238d42cf5d
[instagram:user] Fix extraction (closes #16119) 2018-04-17 22:37:50 +07:00
Remita Amine 522d6b5c96 [cbs] skip DRM asset types(fixes #16104) 2018-04-16 07:48:51 +01:00
Sergey M․ bdf7ba6f3a
Set chmod 644 for all extractors 2018-04-16 01:07:21 +07:00
Sergey M․ c07cb68e79
[smotri:broadcast] Fix extraction (closes #16180) 2018-04-16 00:54:21 +07:00
Sergey M․ a42839e548
[picarto] Improve extraction (closes #6205, closes #12514, closes #15276, closes #15551) 2018-04-16 00:34:47 +07:00
Patrick Griffis d6166a7602
[picarto] Add extractor 2018-04-16 00:32:15 +07:00
Sergey M․ 8e41c9ad01
[vine:user] Improve extraction (closes #16190) 2018-04-15 22:46:43 +07:00
Timmy 9b5aead6aa
[vine:user] Fix extraction (closes #15514) 2018-04-15 22:46:30 +07:00
Sergey M․ 68ddba20ae
[instagram:user] Remove User-Agent from signature (closes #16119) 2018-04-13 22:28:33 +07:00
Sergey M․ 92ded33a05
[pornhub] Relax _VALID_URLs (closes #16165) 2018-04-12 04:53:45 +07:00
Sergey M․ 64f03e5b4c
[cbc:watch] Re-acquire device token when expired (closes #16160) 2018-04-11 23:30:19 +07:00
Ray Douglass d783aee56a [fxnetworks] Add support for https theplatform URLs (closes #16125) 2018-04-11 20:11:24 +07:00
Sergey M․ 315ab3d500
[instagram:user] Simplify signing (#16119) 2018-04-11 01:51:57 +07:00
Sergey M․ dd9aea8cbd
[instagram:user] Add request signing (closes #16119) 2018-04-11 01:25:41 +07:00
Sergey M․ fce7962691
[twitch] Add support for mobile URLs (closes #16146) 2018-04-10 23:07:37 +07:00
Sergey M․ 069937151e
[generic] Add support for tube8 embeds 2018-04-09 00:37:15 +07:00
Sergey M․ d3431dcb90
[generic] Restrict share-videos.se embeds regex to filter bogus URLs (#16115) 2018-04-09 00:25:44 +07:00
Surya Oktafendri 1fc37ca3f1 [generic] Add support for share-videos.se embeds (closes #16089) 2018-04-09 00:19:23 +07:00
Sergey M․ d04ca97616
[odnoklassniki] Improve _VALID_URL readability 2018-04-08 22:21:21 +07:00
GDR! 608c738c7d [odnoklassniki] Extend _VALID_URL (closes #16081) 2018-04-08 22:13:00 +07:00
aeph6Ee0 66b686727b [extractor/common] Relax JSON-LD context check (closes #16006) 2018-04-08 03:09:42 +07:00
Sergey M․ 717ea4e14e
[steam] Bypass mature content check (closes #16113) 2018-04-08 00:29:43 +07:00
Sergey M․ cae5d9705c
[acast] Extract more metadata 2018-04-08 00:21:55 +07:00
Sergey M․ 1c9b1a4494
[acast] Fix extraction (closes #16118) 2018-04-08 00:08:45 +07:00
Sergey M․ ff826177cc
[instagram:user] Fix extraction (closes #16119) 2018-04-07 23:58:57 +07:00
Parmjit Virk 9d15be3a5b [drtuber] Fix title extraction (closes #16107) 2018-04-07 21:39:21 +07:00
Sergey M․ e2750e1437
[liveleak] Extend _VALID_URL (closes #16117) 2018-04-07 20:55:01 +07:00
Sergey M․ e944737c59
[openload] Add support for oload.xyz 2018-04-06 23:40:15 +07:00
Sergey M․ fdfb32a0dd
[openload] Relax stream URL regex 2018-04-06 00:15:22 +07:00
Sergey M․ 235d828b7b
[openload] Fix extraction (closes #16099) 2018-04-05 23:49:15 +07:00
Sergey M․ 1236ac6b0b
[svtplay] Share svtplay regex 2018-04-05 00:29:13 +07:00
Sergey M․ df146eb282
[svtplay:series] Add support for season URLs 2018-04-05 00:29:08 +07:00
Sergey M․ b71bb3ba8b
[svtplay:series] Improve extraction (closes #16059) 2018-04-05 00:29:02 +07:00
Mattias Wadman fd97fa7bfc
[svtplay:series] Add extractor
Related to #11130
2018-04-05 00:28:58 +07:00
Sergey M․ ea6679fbeb
[tvnow] Fix issues, simplify and improve (closes #15837) 2018-04-03 00:08:22 +07:00
AndroKev 3acae1e031
[tvnow] Add support for shows 2018-04-03 00:06:47 +07:00
Sergey M․ 8bd1df3c31
[dramafever] Fix authentication (closes #16067) 2018-04-02 22:19:42 +07:00
Sergey M․ 86693c4930
[afreecatv] Use partial view only when necessary (closes #14450) 2018-04-02 00:00:45 +07:00
Sergey M․ d563fb32ba
[afreecatv] Remove debug output 2018-04-01 23:07:54 +07:00
Sergey M․ e51762be19
[afreecatv] Add support for authentication (#14450) 2018-04-01 22:47:39 +07:00
kenavera 03fcde10ce [nationalgeographic] Add support for new URL schema (closes #16001) 2018-04-01 21:22:51 +07:00
Sergey M․ 95a1322bc1
[bilibili] Remove debug from player params regexes 2018-04-01 02:06:58 +07:00
Parmjit Virk 0669f8fd8f [xvideos] Fix thumbnail extraction (closes #15978) 2018-03-31 23:46:08 +07:00
kenavera 0b4bbcdcb6 [medialaan] Fix vod id 2018-03-31 22:14:49 +07:00
Luca Steeb 3e78d23b57 [openload] Add support for oload.site 2018-03-30 23:25:43 +07:00
Sergey M․ 190f6c936b
[naver] Fix extraction (closes #16029) 2018-03-29 23:49:09 +07:00
Sergey M․ 02f6ccbce3
[dramafever] Partially switch to API v5 (closes #16026) 2018-03-29 23:06:13 +07:00
xofe 9e6a418015 [abc:iview] Unescape title and series meta fields 2018-03-27 22:08:40 +07:00
Attila-Mihaly Balazs 99c3091850 [videa] Extend _VALID_URL 2018-03-27 22:02:04 +07:00
Joseph Spiros 16132cff72 [vrv] Fix extraction on python2 (closes #15928) 2018-03-24 14:57:34 +07:00
Sergey M․ 86e1958944
[afreecatv] Update referrer (closes #15947) 2018-03-24 14:21:08 +07:00
Sergey M․ b015cb1af3
[24video] Add support for 24video.sexy (closes #15973) 2018-03-24 14:11:27 +07:00
Sergey M․ 7d34016fb0
[crackle] Bypass geo restriction 2018-03-24 01:49:50 +07:00
Sergey M․ b9f5a41207
[crackle] Fix extraction (closes #15969) 2018-03-23 23:53:18 +07:00
Sergey M․ 8b7340a45e
[lenta] Add extractor (closes #15953) 2018-03-22 23:07:31 +07:00
Chih-Hsuan Yen 1d4a0520ba
Merge pull request #15939 from sudovijay/patch-11
[Youku] Update ccode
2018-03-22 14:42:35 +08:00
Sergey M․ cba5d1b6b3
[instagram:user] Add pagination (closes #15934) 2018-03-21 23:43:03 +07:00
Vijay Singh 328ddf56a1
[Youku] Update ccode 2018-03-21 12:13:31 +05:30
Philipp Hagemeister 3395958d2b libsyn: adapt to new page structure and replace testcase 2018-03-20 23:07:11 +01:00
Sergey M․ d9e2240f7c
[7plus] Extract series metadata (closes #15862, closes #15906) 2018-03-20 01:40:53 +07:00
Sergey M․ 832f9d5258
[9now] Bypass geo restriction (closes #15920) 2018-03-20 01:08:03 +07:00
Sergey M․ 21dedcb580
[cbs] Skip unavailable assets (closes #13490, closes #13506, closes #15776) 2018-03-20 00:27:39 +07:00
Sergey M․ 6780154e6b
[extractor/common] Improve thumbnail extraction for HTML5 entries 2018-03-19 23:43:53 +07:00
Sergey M․ 38f59e2793
[canalc2] Add support for HTML5 videos (closes #15916, closes #15919) 2018-03-19 23:40:19 +07:00
Sergey M․ 9a054fcbba
[ceskatelevize] Add support for iframe embeds (closes #15918) 2018-03-19 23:29:53 +07:00
kayb94 6e3f23d912 [prosiebensat1] Add support for galileo.tv (closes #15894) 2018-03-19 04:14:33 +07:00
Sergey M․ 47a5cb7734
Generalize XML manifest processing code and improve XSPF parsing (closes #15794) 2018-03-18 02:52:17 +07:00
Sergey M․ e0d198c18d
[extractor/common] Add _download_xml_handle 2018-03-18 02:52:01 +07:00
Ricardo Constantino 96b8b9abae
[extractor/generic] Support relative URIs in _parse_xspf
<location> can have relative URIs, not just absolute.
2018-03-18 02:48:44 +07:00
Sergey M․ 178ee88319
[generic] Add support for xfileshare embeds (closes #15879) 2018-03-17 23:57:07 +07:00
Sergey M․ d123960857
[bilibili] Switch to v2 playurl API 2018-03-16 03:18:53 +07:00
Sergey M․ 3526c3043b
[bilibili] Fix and improve extraction (closes #15048, closes #15430, closes #15622, closes #15863) 2018-03-16 00:19:17 +07:00
Sergey M․ 8e70c1bfac
[heise] Improve extraction (closes #15496, closes #15784, closes #15026) 2018-03-15 23:09:24 +07:00
Remita Amine 27b1c73f14 [instagram] fix user videos extraction(fixes #15858) 2018-03-15 14:33:36 +01:00
Sergey M․ b8c6badc96
[soundcloud] Update client id (closes #15866) 2018-03-14 22:38:55 +07:00
Philipp Hagemeister b848a4ca1a [tennistv] Remove duplicate key in dictionary 2018-03-14 11:48:26 +01:00
Philipp Hagemeister e6e68069f6 [tennistv] Correctly encode POST parameters
In python 3.x, the POST parameters must be bytes, not str.
2018-03-14 11:23:10 +01:00
Philipp Hagemeister f3672ac522 [line] lint (remove space on empty line) 2018-03-14 09:55:46 +01:00
Philipp Hagemeister f226880c6d [tennistv] Add support for tennistv.com 2018-03-14 09:55:21 +01:00
Chih-Hsuan Yen 08250b69c2 [line] Add support for tv.line.me (closes #9427) 2018-03-11 22:25:30 +08:00
Sergey M․ d116918993
[raywenderlich] PEP 8
[ci skip]
2018-03-10 23:15:11 +07:00
Sergey M․ 7399ca1f80
[pornhub] PEP 8
[ci skip]
2018-03-10 23:14:37 +07:00
Sergey M․ b4a190fe2a
[xnxx] Fix extraction (closes #15817) 2018-03-10 23:13:14 +07:00
Sergey M․ cc7f6c720e
[njpwworld] Fix authentication (closes #15815) 2018-03-10 22:35:47 +07:00
Sergey M․ 5b1d158834
[raywenderlich] Extract videos in order 2018-03-10 04:31:51 +07:00