mirrors/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-11-18 06:09:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
15122 commits 3 branches 100 tags 146 MiB
Commit graph

9924 commits

Author SHA1 Message Date
Sergey M․ d7344d33b1
[telequebec] Fix description extraction and update test (closes #12399) 2017-03-08 18:25:59 +07:00
denneboomyo b08cc749d6 [openload] Fix extraction 2017-03-08 06:01:27 +08:00
Sergey M․ b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer 2017-03-07 23:00:21 +07:00
Sergey M․ 2e76bdc850
[brightcove:legacy] Relax videoPlayer validation check (closes #12381) 2017-03-07 22:59:33 +07:00
Yen Chi Hsuan fe646a2f10
[twitch] PEP8 2017-03-07 15:34:06 +08:00
Sergey M․ e30ccf7047
[soundcloud] Update client id (closes #12376) 2017-03-06 23:05:38 +07:00
denneboomyo da92da4b88 Openload fix extraction (#12357) 
* Fix extraction
 2017-03-06 18:00:17 +08:00
Sergey M․ 96182695e4
[drtv] Add geo countries to GeoRestrictedError 2017-03-06 03:23:42 +07:00
Sergey M․ fc11ad3833
[drtv:live] Bypass geo restriction 2017-03-06 03:23:42 +07:00
Yen Chi Hsuan d2b64e04b4
[addanime] Skip an invalid test 2017-03-06 00:35:04 +08:00
Sergey M․ 5dd376345b
[tunepk] Add extractor (closes #12197, closes #12243) 2017-03-05 23:31:38 +07:00
Sergey M․ 1a2192cb90
[extractor/common] Pass arguments to _parse_jwplayer_formats and PEP8 2017-03-05 23:29:17 +07:00
Sergey M․ 0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate 2017-03-05 23:25:03 +07:00
Sergey M․ ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method 2017-03-05 23:22:27 +07:00
Sergey M․ 5316566edc
[twitch] Use better naming and simplify (closes #11974) 2017-03-05 02:06:33 +07:00
Xiao Di Guan c64c03be35
[twitch] Add basic support for two-factor authentication 2017-03-05 01:06:27 +07:00
Lars Vierbergen a3ba8a7acf [vier] Add support for vijf.be 
vier.be and vijf.be run on the same CMS and are property of the same company,
so the same extractor can be used for both of them.
 2017-03-05 00:47:19 +08:00
Sergey M․ 054a587de8
[redbulltv] Improve extraction (closes #11948, closes #3919) 2017-03-04 23:28:21 +07:00
Juanjo Benages 64b7ccef3e
[redbulltv] Add extractor 2017-03-04 23:26:15 +07:00
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation 
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
 2017-03-04 23:23:18 +08:00
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds 2017-03-04 00:46:33 +07:00
Sergey M․ bc82f22879
[rutube] Relax _VALID_URL 2017-03-04 00:42:51 +07:00
Sergey M․ 4d058c9862
[vrak] Improve and update test (closes #11452) 2017-03-03 23:58:16 +07:00
Sergey M․ d16f27ca27
[brightcove:new] Add ability to smuggle geo_countries into URL 2017-03-03 23:58:03 +07:00
Olivier Bilodeau cbb127568a
[vrak] Add extractor 2017-03-03 23:54:21 +07:00
Sergey M․ d02d4fa0a9
[brightcove:new] Raise GeoRestrictedError 2017-03-03 22:49:48 +07:00
Sergey M․ 692fa200ca
[go] Relax _VALID_URL (closes #12341) 2017-03-03 22:28:34 +07:00
Sergey M․ 9bae185ba6
[24video] Use original host for requests (closes #12339) 2017-03-03 22:16:00 +07:00
Sergey M․ 4d345bf17b
[ruutu] Disable DASH formats (closes #12322) 
Due to causing out of sync issue
 2017-03-02 23:53:46 +07:00
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323) 
Almost all videos now use the pagelet type 'permalink_video_pagelet'
 2017-03-02 20:51:24 +08:00
Yen Chi Hsuan c9612c0487
[youtube] Mark errors about rental videos as expected 
Closes #12324
 2017-03-02 16:59:53 +08:00
Yen Chi Hsuan af5049f128
[adobepass] Add Charter Spectrum (#11465) 
Thanks @tv21 for the fix!
 2017-03-02 02:15:51 +08:00
Sergey M․ 4b8a984c67
[npo] Add support for audio 2017-03-01 22:21:13 +07:00
Sergey M․ 83e8fce628
[npo] Improve extraction and update tests 2017-03-01 22:14:46 +07:00
Sergey M․ aa9cc2ecbf
[npo] Adapt to app.php API (closes #12311) 2017-03-01 05:03:35 +07:00
Sergey M․ 43b38424a9
[azmedien:showplaylist] Improve (closes #12160) 2017-02-28 23:37:54 +07:00
Alex Seiler 948519b35d
[azmedien:showplaylist] Add support for all episodes playlists 2017-02-28 23:36:05 +07:00
Sergey M․ 87dadd456a
[youtube:playlist] Recognize another playlist pattern (closes #11928, closes #12286) 2017-02-28 23:06:47 +07:00
Yen Chi Hsuan 7c4aa6fd6f
[daisuki] Add subtitles (#4738) 2017-02-28 22:29:01 +08:00
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS 
They've switched from flv to hls

Closes #12301
 2017-02-28 21:41:03 +08:00
Sergey M․ 18abb74376
[npo] Relax _VALID_URL for zapp.nl 2017-02-27 23:13:51 +07:00
Sergey M․ dbc01fdb6f
[hetklokhuis] Fix IE_NAME 2017-02-27 23:10:29 +07:00
Sergey M․ f264c62334
[npo] Add support for zapp.nl 2017-02-27 23:10:00 +07:00
Sergey M․ 0dc5a86a32
[npo] Add support for hetklokhuis.nl (closes #12293) 2017-02-27 22:43:19 +07:00
Sergey M․ 0e879f432a
[youtube:channel] Remove duplicate test 2017-02-27 22:22:43 +07:00
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315) 
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
 2017-02-27 21:34:33 +08:00
Alex Seiler fdeea72611 [cda] Decode URL (fixes #12255) 2017-02-26 22:05:52 +08:00
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link 
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes #12267.
 2017-02-26 19:08:10 +08:00
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError 2017-02-26 16:52:40 +07:00
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError 2017-02-26 16:52:40 +07:00
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS 
Ref: #12169
 2017-02-26 17:24:54 +08:00
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError 2017-02-25 23:27:45 +07:00
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes #12175) 2017-02-25 22:56:42 +07:00
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor 2017-02-25 22:55:17 +07:00
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error (#12263) 2017-02-25 20:38:21 +07:00
Sergey M․ 922ab7840b
[etonline] Add extractor (closes #12236) 2017-02-25 20:16:40 +07:00
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries 
Some websites, like NJPWorld, put different qualities on different
player pages.
 2017-02-25 18:40:05 +08:00
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL (#12127) 2017-02-25 02:51:53 +07:00
Sergey M․ ad3033037c
[noco] Modernize 2017-02-24 21:51:56 +07:00
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes #12246) 2017-02-24 21:48:34 +07:00
Sergey M․ 441d7a32e5
[thescene] Extract more metadata 2017-02-24 21:22:29 +07:00
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes #12235) 2017-02-24 22:08:45 +08:00
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism 2017-02-24 12:27:56 +01:00
Remita Amine 39e7277ed1 [openload] fix extraction(closes #10408) 2017-02-24 11:21:58 +01:00
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError 2017-02-24 10:54:39 +07:00
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes #12238) 2017-02-24 05:01:31 +07:00
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes #12087)(closes #12210) 2017-02-23 18:42:06 +01:00
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes #12221) 2017-02-23 18:45:38 +07:00
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes #12226) 2017-02-23 18:02:04 +07:00
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids 2017-02-23 11:57:18 +01:00
Remita Amine 30eaa3a702 [mgtv] fix extraction 2017-02-23 11:57:05 +01:00
Remita Amine c59f703610 [sohu] raise GeoRestrictedError 2017-02-23 11:56:55 +01:00
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism 2017-02-23 11:56:45 +01:00
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes #12209) 
Not served anymore
 2017-02-22 21:49:30 +07:00
Sergey M․ 58ad6995cd
[vidzi] Add test for #12213 2017-02-22 21:29:53 +07:00
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc 2017-02-22 22:28:09 +08:00
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes #12217) 2017-02-22 21:19:52 +07:00
Remita Amine abd29a2ced [crackle] use geo bypass mechanism 2017-02-21 19:37:26 +01:00
Remita Amine 31615ac279 [viewster] use geo verifcation headers 2017-02-21 19:36:39 +01:00
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism" 
This reverts commit 86466a8b6f.
 2017-02-21 18:14:55 +01:00
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism 2017-02-21 17:52:50 +01:00
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism 2017-02-21 17:52:50 +01:00
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism 2017-02-21 17:52:50 +01:00
Remita Amine 3444844b04 [limelight] extract PlaylistService errors 2017-02-21 17:52:50 +01:00
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP 2017-02-21 23:14:33 +07:00
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries 2017-02-21 23:09:41 +07:00
Sergey M․ dc0a869e5e
[extractor/common] Fix typo 2017-02-21 23:05:31 +07:00
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors (#11970) 2017-02-21 23:00:43 +07:00
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism 2017-02-21 14:38:00 +01:00
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes #12191) 2017-02-20 19:00:40 +01:00
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes #12193) 2017-02-21 00:54:43 +07:00
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental 2017-02-20 23:21:15 +07:00
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass 2017-02-20 23:17:19 +07:00
Sergey M․ 82f662182b
[iprima] Modernize 2017-02-20 23:16:14 +07:00
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2 2017-02-20 03:06:52 +07:00
Sergey M․ 6d4c259765
[svt] PEP 8 2017-02-20 02:25:55 +07:00
Sergey M․ c78dd35491
[nrk] PEP 8 2017-02-20 02:25:39 +07:00
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes #12180) 2017-02-20 01:00:53 +07:00
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL 2017-02-20 00:59:31 +07:00
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection 2017-02-19 06:25:59 +07:00
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes #12177) 2017-02-19 06:16:00 +07:00
Sergey M․ 4248dad92b Improve geo bypass mechanism 
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
 2017-02-19 05:10:08 +08:00
Sergey M․ 0a840f584c Rename bypass geo restriction options 2017-02-19 05:10:08 +08:00
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers 2017-02-19 05:10:08 +08:00
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection 2017-02-19 05:10:08 +08:00
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection 2017-02-19 05:10:08 +08:00
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection 2017-02-19 05:10:08 +08:00
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ 04d906eae3 [svt] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ 8ab8066cf0 [pbs] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ 01b1aa9ff4 [ondemandkorea] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ ff4007891f [nrk] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ 28200e654b [itv] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ e633f21a96 [go] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ d392005a79 [dramafever] Improve geo restriction detection and use geo bypass mechanism 2017-02-19 05:10:08 +08:00
Sergey M․ 773f291dcb Add experimental geo restriction bypass mechanism 
Based on faking X-Forwarded-For HTTP header
 2017-02-19 05:10:08 +08:00
Remita Amine 049a0f4d6d [brightcove:legacy] restrict videoPlayer value(closes #12040) 2017-02-18 21:08:40 +01:00
Sergey M․ e84888b432
[tvn24] Improve extraction (closes #11679) 2017-02-18 23:34:09 +07:00
Jakub Wilk 02d9b82a23
[tvn24] Add extractor 2017-02-18 23:33:49 +07:00
Sergey M․ a2e3286676
[thisav] Add support for html5 media (closes #11771) 2017-02-18 20:21:53 +07:00
Sergey M․ f75caf059e
[metacafe] Improve (closes #10371) 2017-02-18 19:58:25 +07:00
Alex Monk bdabbc220c
[metacafe] Bypass family filter 
If you don't send this user=ffilter: false cookie, it will 301 redirect you to a page asking about it, and then the title check will fail.
 2017-02-18 19:47:33 +07:00
Remita Amine 70bcc444a9 [viceland] improve info extraction and update test 2017-02-18 09:52:43 +01:00
Sergey M․ bad4ccdb5d
[heise] Improve (closes #9725) 2017-02-17 23:09:40 +07:00
Tobias Gruetzmacher db76c30c6e
[heise] Support videos embedded in any article. 2017-02-17 22:55:53 +07:00
Déstin Reed c2bde5d081
[ellentv] Improve 2017-02-17 22:45:51 +07:00
Sergey M․ 90fad0e74c
[openload] Fix extraction (closes #12002) 2017-02-17 22:31:16 +07:00
Vijay Singh d94badc755
[openload] Semifix extraction (closes #10408) 
just updated the code. i don't do much python still i tried to convert my code. lemme know if there is any prob with it
 2017-02-17 22:30:05 +07:00
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Sergey M․ 4cead6a614
[einthusan] Relax _VALID_URL (closes #12141, closes #12159) 2017-02-17 22:02:01 +07:00
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Sergey M․ b898f0a173
[elpais] Fix typo and improve extraction (closes #12139) 2017-02-16 04:57:42 +07:00
Sergey M․ eafaeb226a
[ceskatelevize] Lower priority for audio description sources (#12119) 2017-02-16 00:04:15 +07:00
Sergey M․ de4d378c0c
[ceskatelevize] Prefix format ids 2017-02-15 23:38:00 +07:00
Remita Amine 1bd05345ea [amcnetworks] fix extraction(closes #12127) 2017-02-15 14:19:18 +01:00
Sergey M․ 3021cf83b7
[pinkbike] Fix uploader extraction (closes #12054) 2017-02-15 02:08:32 +07:00
Sergey M․ 04a741232f
[onetpl] Add support for businessinsider.com.pl and plejada.pl 2017-02-15 01:23:55 +07:00
Sergey M․ 43a3d9edfc
[onetpl] Add support for onet.pl (closes #10507) 2017-02-15 01:14:06 +07:00
Sergey M․ d31aa74fdb
[onetmvp] Add shortcut extractor 2017-02-15 00:58:18 +07:00
Sergey M․ 6092ccd058
[vodpl] Make more robust and add another test (closes #12122) 2017-02-15 00:52:31 +07:00
Marek Rusinowski 22ce9ad2bd
[vod.pl] Add new extractor 2017-02-15 00:48:08 +07:00
Sergey M․ 9a372f14b4
[pornhub] Extract video URL from tv platform site (#12007, #12129) 2017-02-14 23:52:41 +07:00
Sergey M․ 5cb2d36c82
[ceskatelevize] Extract DASH formats (closes #12119, closes #12133) 2017-02-14 22:57:38 +07:00
Ondřej Caletka fcca0d53a8
[ceskatelevize] Quick fix to revert to using old HLS-based playlist 
This fixes recent changes in iVysilani. Proper patch should migrate to
MPEG-DASH version, which is now the default.
 2017-02-14 22:25:37 +07:00
Sergey M․ 50de3dbad3
[zdf] Fix extraction (closes #12117) 2017-02-14 01:00:06 +07:00
Sergey M․ 085f169ffe
[xtube] Fix extraction for both kinds of video id (closes #12088) 2017-02-13 23:44:43 +07:00
Vobe f6d6ca1db3
[xtube] Improve title extraction 2017-02-13 23:34:14 +07:00
Sergey M․ 6e5956e6ba
[lemonde] Fallback delegate extraction to generic extractor (closes #12115, closes #12116) 2017-02-13 23:17:48 +07:00
Remita Amine 89c6691f9d [bellmedia] accept longer video id(closes #12114) 2017-02-13 15:08:48 +01:00
Remita Amine 454e5cdb17 [limelight] add support referer protected videos 2017-02-13 14:29:05 +01:00
Remita Amine 9dad941853 [disney] improve extraction 
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes #4975
closes #11000
closes #11882
closes #11936
 2017-02-13 11:43:20 +01:00
Remita Amine 0dac7cbb09 [hotstar] improve extraction(closes #12096) 
- extract all qualities
- detect drm protected videos
- extract more metadata
 2017-02-12 17:35:24 +01:00
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes #11416) 
The old test URLs are no longer valid, so I replace them with the one
from #11416
 2017-02-12 20:53:55 +08:00
Aniruddh-J 459818e280 [aenetworks] Add support for lifetimemovieclub.com 2017-02-12 20:18:11 +08:00
Sergey M․ 6310acf512
[youtube] Fix parsing codecs (closes #12091) 2017-02-12 18:09:53 +07:00
Yen Chi Hsuan 68c22c4c15
[iqiyi] Update _TESTS 2017-02-11 22:27:45 +08:00
Sergey M․ 3d7e3aaa0e
[pluralsight:course] Fix extraction (closes #12075) 2017-02-11 17:00:52 +07:00
Sergey M․ 624c4b92ff
[facebook] Add coding cookie 2017-02-11 16:18:45 +07:00
Remita Amine 97eb9bd2ac [bbc] extract m3u8 formats with 320k audio 2017-02-10 19:46:15 +01:00
Sergey M․ 71cdd75628
[facebook] Relax video id matching (closes #11017, closes #12055, closes #12056) 2017-02-11 01:05:22 +07:00
Remita Amine c7d6f614f3 [corus] Add new extractor(closes #12060)(#9164) 2017-02-10 17:00:09 +01:00
Remita Amine 08a00eef79 [extractor/common] skip m3u8 manifests protected with Adobe Flash Access 2017-02-10 17:00:09 +01:00
Sergey M․ 9dd5408c99
[pluralsight] Detect blocked account error message (#12070) 2017-02-10 22:48:11 +07:00
Sergey M․ 9510709575
[bloomberg] Add another video id regex (closes #12062) 2017-02-10 22:16:20 +07:00
Remita Amine 5abcca9060 [sixplay] use raw string for regex 2017-02-10 09:34:59 +01:00
Sergey M․ e01bfc19c3
[extractor/commonmistakes] Restrict _VALID_URL (closes #12050) 2017-02-10 09:39:24 +07:00
Remita Amine 4d32b63851 [tvplayer] Add new extractor 2017-02-09 23:09:21 +01:00
Sergey M․ ff24261ba0
[kaltura] Add explicit port to regexes 
They should not match e.g. cdnapi.kaltura.computernetworks.com/...
 2017-02-10 01:24:14 +07:00
Sergey M․ fbc6dc525e
[xtube] Fix shortcuts 2017-02-10 01:06:23 +07:00
Sergey M․ 9150d1eb69
[xtube] Fix extraction (closes #12023) 2017-02-10 01:03:35 +07:00
Sergey M․ b7f9843bec
[pornhub] Simplify (closes #12018) 2017-02-10 00:57:44 +07:00
Thomas Christlieb e64b0fca14
[pornhub] Fix extraction (closes #12007) 2017-02-10 00:56:12 +07:00
Sergey M․ 78ef214d2d
[facebook] Improve JS data regex (closes #12042) 2017-02-09 23:42:40 +07:00
Remita Amine 37084f6641 [kaltura] improve embed partner id extraction(fixes #12041) 2017-02-09 16:24:54 +01:00
Remita Amine b04975733c [sprout] Add new extractor 2017-02-09 09:13:29 +01:00
Remita Amine c8b8fb0a99 [sixplay] improve extraction 
- skip drm protected formats
- extract more and better formats
- skip duplicate asset urls
 2017-02-08 22:56:10 +01:00
Remita Amine 8298018273 [scrippsnetworks:watch] Add new extractor(closes #10765) 2017-02-08 20:44:23 +01:00
Remita Amine ae8d5a5c59 [go] add support for adobe pass auth(closes #11468)(closes #10831) 2017-02-08 18:57:07 +01:00
Sergey M․ b9c9cb5f79
[6play] Fix extraction (closes #12011) 2017-02-08 23:15:39 +07:00
Remita Amine fdf9b959bc [nbc] add support adobe pass auth(closes #12006) 2017-02-08 16:23:42 +01:00
Sergey M․ f28aeff264
[pornhub] Fix extraction (closes #11997) 2017-02-07 01:52:59 +07:00
Sergey M․ 242a14a1f6
[extractor/common] Fix audio only with audio group in m3u8 (closes #11995) 2017-02-07 00:22:16 +07:00
Sergey M․ d5d904ff7d
[canalplus] Add support for cstar.fr (#11990) 2017-02-06 23:53:42 +07:00
Sergey M․ 5620f840f6
[extractor/generic] Add test for #11993 and more metadata for rtmp 2017-02-06 23:31:58 +07:00
Sergey M․ b7a8c1bcfa
[extractor/generic] Improve rtmp support (closes #11993) 2017-02-06 23:23:40 +07:00
Sergey M․ 2aec7256ae
[extractor/common] Speed-up media tags regex (closes #11979) 2017-02-06 00:20:30 +07:00
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
motophil e705755739 [gaskrank] Add new extractor (#11685) 
* [gaskrank] Add new extractor

* [gaskrank] Add new extractor - fixes as requested

* [gaskrank] Add new extractor - style fix

* [Gaskrank] Add new extractor - requested fixes

* [Gaskrank] Add new extractor - fix md5 checksum

* [gaskrank] Add new extractor - more requested fixes

* [Gaskrank] Add new extractor - fixed all but one quantified code issues

* [Gaskrank] add new extractor - more fields extracted, added second test

* [Gaskrank] Add new extractor - requested fixes.

* [Gaskrank] Add new extractor - requested changes.

* [Gaskrank] Add new extractor - final(?) fixes.
 2017-02-06 00:19:37 +08:00
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums 
Closes #11727
 2017-02-05 22:47:04 +08:00
Yen Chi Hsuan 2ab2c0d1f5
[iwara] Add width (closes #11724) 
The heuristic is from #11724
 2017-02-05 22:30:13 +08:00
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6 
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
 2017-02-05 21:41:08 +08:00
Sergey M․ 6ef3e65a7b
[videopress] Add extractor 2017-02-05 13:37:27 +07:00
Sergey M․ 6fd138bed8
[sportbox] PEP 8 2017-02-05 13:36:52 +07:00
Remita Amine 3d2c2752c5 [afreecatv] extract rtmp formats 2017-02-04 18:18:28 +01:00
Sergey M․ 9db8f6c540
[twitch:stream] Improve _VALID_URL (closes #11971) 2017-02-04 23:21:07 +07:00
Remita Amine 8e4041cf3f [radiocanada] fix extraction for toutv rtmp formats 2017-02-04 17:05:35 +01:00
John Hawkinson c2521c1ac6 [Piksel] Add another app token regex 2017-02-04 23:23:14 +08:00
A Connecticut Princess 643dc0fcfe
[vk] Catch author blocked error message 
Example link (video in blocked group):
https://vk.com/search?c%5Bq%5D=%D0%9F%D1%80%D1%8B%D0%B6%D0%BE%D0%BA%20c%20%D0%BA%D1%80%D0%B0%D0%BD%D0%B0%20%D0%B2%20%D1%81%D1%82%D0%B8%D0%BB%D0%B5%20%D0%A7%D0%B5%D0%BB%D0%BE%D0%B2%D0%B5%D0%BA%D0%B0-%D0%BF%D0%B0%D1%83%D0%BA%D0%B0&c%5Bsection%5D=video&c%5Bsort%5D=2&z=video-10639516_456240611
 2017-02-04 22:21:09 +07:00
Remita Amine 36fce54816 [turner] fix downloading of secure hls formats using ffmpeg(closes #11358)(closes #11373)(closes #11800) 2017-02-04 15:23:46 +01:00
Remita Amine 2c15db829c [drtv] add support for live and radio sections(closes #1827)(closes #3427) 2017-02-04 08:38:28 +01:00
Remita Amine f65dba7cdb [myspace] fix extraction and extract hls and http formats 2017-02-03 22:25:19 +01:00
Remita Amine 605fd6392f [youtube] add format info for itag 325 and 328 2017-02-03 17:59:48 +01:00
Sergey M․ f962790ee5
[vine] Fix extraction (closes #11955) 2017-02-03 21:56:48 +07:00
Sergey M․ b7cc5f078e
[extractors] Remove remnants of sportbox extractor (#11954) 2017-02-03 21:56:10 +07:00
Sergey M․ f7a10d8cd6
[sportbox] Remove extractor (closes #11954) 
Covered by generic extractor
 2017-02-03 21:25:44 +07:00
Remita Amine df0588a31f Merge branch 'fstirlitz-filmon' 2017-02-03 10:15:52 +01:00
Remita Amine 4ce3407d08 [filmon] improve extraction 2017-02-03 10:15:03 +01:00
Mattias Wadman 45024183ae [infoq] Add audio only format if available (#11565) 
* [infoq] Add audio only format if available

Refactor cookie code into a function.
Renamed formats to http_video, http_audio, rtmp_video
Renamed extract functions to video instead of videos as they return
one or no video.

* [infoq] Rename to _extract_cookies as it more than one

* [infoq] Remove redundant determine_ext

* [infoq] Add comment about hardcoded URL

* [infoq] Use _hidden_inputs instead of messy regex

* [infoq] Probe if audio URL is valid

Make it possible to pass headers to _is_valid_url

* [infoq] Add audio only test
 2017-02-03 12:10:13 +08:00
Justsoos 33da98f493
[douyutv] Improve room id regex 
http://www.douyu.com/t/lpl  source get extra '\' with "room_id\" (from js coding)
 2017-02-03 03:26:41 +07:00
Michal Čihař 0bbcc8a10a
[iprima] Fix extraction (closes #11920, closes #11896) 2017-02-03 03:04:33 +07:00
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided 
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
 2017-02-03 01:28:24 +08:00
Sergey M․ c54c01f82d
[go] Relax video id regex (closes #11937) 2017-02-02 23:04:46 +07:00
Sergey M․ 5a116e1302
[facebook] Fix title extraction (closes #11941) 2017-02-02 22:45:18 +07:00
Sergey M․ a685751051
[youtube:playlist] Recognize TL playlists (closes #11945) 2017-02-02 22:01:11 +07:00
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845) 
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
 2017-02-02 21:51:31 +08:00
Remita Amine 81aeafeb44 [cbc:watch] extract audio codec for audion only formats(fixes #11893) 2017-02-02 08:07:28 +01:00
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․ b83ef507b4
[facebook] Fix extraction (closes #11926) 2017-02-01 23:19:20 +07:00
Yen Chi Hsuan fe5aa197b5
[prosiebensat1] PEP8 and update _TESTS 2017-02-01 23:13:45 +08:00
Thomas Christlieb 7882f1115e Added new Regex for prosiebensat1 Extractor Description. Fixes #11810 (#11929) 
* Added new Regex for prosiebensat1 Extractor Description. Fixes #11810

* Using _og_search_description() as a Fallback for Description-Regex

* Using _og_search_description() as a Fallback for Description-Regex - Second try

* Also added fallback regex

* Using _og_search_description() as a Fallback for Description-Regex - Third try

* removed fatal=False from search for description regex. default=None should be preferred only

* Using fatal=false for _og_search_description

* Revert "Using fatal=false for _og_search_description"

This reverts commit 2b7e123f9d0f2bd6ada54fa8e4e6035fece5dbf4.

* Deleted default=None Parameter for _og_search_property
 2017-02-01 23:00:41 +08:00
Yen Chi Hsuan 2b2d5d319b
[crunchyroll] Remove ScaledBorderAndShadow settings 
See https://github.com/rg3/youtube-dl/pull/9028, especially @lachs0r's
comments for the reason behind this change
 2017-02-01 16:39:32 +08:00
Sergey M․ 26c0f09935
[vimeo] PEP 8 2017-02-01 02:15:52 +07:00
Sergey M․ c15cd29640
[vimeo] Extract upload timestamp 2017-02-01 00:58:02 +07:00
Sergey M․ c38a67bcd5
[vimeo] Extract license (closes #11880) 2017-02-01 00:49:28 +07:00
Sergey M․ 7c5329e6f4
[nrk] Improve extraction and update tests (closes #11571) 2017-02-01 00:29:29 +07:00
Odd Stråbø 8fd65faece
[NRKTV] Added NRKTVSeriesIE 
[NRKTV] Added season and episode number to metadata.

[NRKTV] Added category to metadata.

[NRKTV] Added tests to NRKTVSeries.

[NRKTV] Fixed whitespace issues (flake8).
 2017-01-31 23:10:40 +07:00
Sergey M․ 3c90cc8b6f
[youtube] Fix extraction for domainless player URLs 
Closes #11890
Closes #11891
Closes #11892
Closes #11894
Closes #11895
Closes #11897
Closes #11900
Closes #11903
Closes #11904
Closes #11906
Closes #11907
Closes #11909
Closes #11913
Closes #11914
Closes #11915
Closes #11916
Closes #11917
Closes #11918
Closes #11919
 2017-01-31 22:22:37 +07:00
Remita Amine ae9a173b64 [vimeo] extract both mixed and separated dash formats 2017-01-31 14:47:56 +01:00
Remita Amine dadb836139 [ruutu] extract dash formats 2017-01-30 09:32:31 +01:00
Remita Amine 4719419951 [itv] fix extraction in python 2.6 2017-01-29 16:04:15 +01:00
Alex Seiler f13da8af28
[azmedien:playlist] Add support for topic and themen playlists 2017-01-29 20:40:19 +07:00
Sergey M․ e228616c6e
[extractor/common] Fix initialization template (closes #11605, closes #11825) 2017-01-29 06:57:39 +07:00
Sergey M․ c58c2d63cb
[extractor/common] Document forgotten fragment base and path interfaces 2017-01-29 05:57:53 +07:00
Sergey M․ d04621daf4
[extractor/common] Fix duration per dash segment (closes #11868) 2017-01-29 05:36:53 +07:00
Andre Walker 56fc078da8 [npo] Update subtitles url 
NPO websites changed the domain they used for subtitles, from
e.omroep.nl to tt888.omroep.nl.
 2017-01-29 02:29:39 +07:00
Remita Amine 4edeac5bfa [itv] fix subtitle extraction 2017-01-28 17:28:18 +01:00
Remita Amine f592ff9868 [itv] extract subtitles 2017-01-28 17:26:14 +01:00
Remita Amine a71b8d3b3b [itv] Add new extractor(closes #9240) 2017-01-28 15:52:50 +01:00
Sergey M․ 008f247077
[mtv81] Add extractor (closes #7619) 2017-01-28 20:29:22 +07:00
Sergey M․ 661cc229d2
[vlive:channel] Improve 2017-01-28 19:08:01 +07:00
ping b92d3c5343 [vlive] Add support for channels 2017-01-28 18:50:38 +07:00
Sergey M․ ab6f6aee78
[kaltura] Add fallback for fileExt 2017-01-28 18:27:42 +07:00
Sergey M․ 26e40542dd
[kaltura] Improve uploader_id extraction 2017-01-28 17:50:56 +07:00
Alex Seiler 99a0baf370
[konserthusetplay] Add support for rspoplay.se 2017-01-28 01:58:23 +07:00
Sergey M․ e0b6e50ccd
[crunchyroll] Improve series and season metadata extraction (closes #11832) 2017-01-27 23:55:55 +07:00
Sergey M․ 3a194cb4ec
[soundcloud] Improve formats extraction and extract audio bitrate 2017-01-27 23:16:30 +07:00
Sergey M․ 9b73471801
[soundcloud] Extract hls formats 2017-01-27 23:08:32 +07:00
Sergey M․ 489ffc1182
[soundcloud] Fix track URL extraction (closes #11852) 2017-01-27 22:55:42 +07:00
Sergey M․ 0b23c222ba
[twitch:vod] Expand _VALID_URL (closes #11846) 2017-01-27 21:33:05 +07:00
Remita Amine b51a4ebed4 [aenetworks] fix season episodes extraction(fixes #11669) 2017-01-26 19:15:43 +01:00
Remita Amine 9463637887 [tva] Add new extractor(closes #11842) 2017-01-26 18:37:22 +01:00
Sergey M․ 3cbecdd111
[jamendo] Improve and extract more metadata (closes #11836) 2017-01-26 23:26:18 +07:00
Stefan Pöschel c19ef77c31
[jamendo] Extract full title 2017-01-26 22:53:16 +07:00
Remita Amine b3277115a1 [disney] Add new extractor(closes #7409)(closes #11801)(#4975)(#11000) 2017-01-26 16:16:14 +01:00
Remita Amine 9bccdc7004 [vevo] remove request to old api and catch apiv2 errors 2017-01-26 16:16:14 +01:00
Sergey M․ cf0cabbe50
[cmt,mtv,southpark] Add support for episode URLs (closes #11837) 2017-01-26 21:49:34 +07:00
Sergey M․ 556dbe7fe3
[youtube] Add fallback for duration extraction (closes #11841) 2017-01-26 21:43:14 +07:00
Sergey M․ c1fa3f4672
[openload] Fallback video extension to mp4 2017-01-25 23:28:45 +07:00
Sergey M․ 17f8deeb48
[extractor/generic] Add support for openload embeds (closes #11536, closes #11812) 2017-01-25 23:27:22 +07:00
Remita Amine b8a03b6660 [srgssr] fix rts video extraction(closes #11831) 2017-01-25 07:39:41 +01:00
Remita Amine c60089c022 [afreecatv:global] Add new extractor(closes #11807) 2017-01-25 07:39:41 +01:00
Sergey M․ af59bddc4e
[konserthusetplay] Extract subtitles (#11823) 2017-01-24 23:03:09 +07:00
Remita Amine 23b35a634e [crackle] improve extraction 
- extract vtt subtitles
- extract multiple resolutions for thumbnails
- pass geo verification proxy headers
- add support for mobile urls
 2017-01-24 16:57:22 +01:00
Sergey M․ 74af9c700d
[konserthusetplay] Add support for hls formats (closes #11823) 2017-01-24 22:55:49 +07:00
Sergey M․ d61aa5eb37
[vimeo:review] Fix config URL extraction (closes #11821) 2017-01-24 22:46:40 +07:00
Sergey M․ b494d6856c
[pluralsight] Fix extraction (closes #11820) 2017-01-24 02:51:45 +07:00
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․ 6d119c2a6b
[24video] Fix extraction (closes #11811) 2017-01-23 03:50:39 +07:00
Sergey M․ 4201ba13e6
[youtube:playlist] Fix nonexistent/private playlist detection and skip private tests 2017-01-23 02:49:56 +07:00
Grzegorz P 8bc0800d7c [youtube:playlist] Fix nonexistent/private playlist detection (closes #11604) 2017-01-23 02:35:38 +07:00
Alex Seiler a089545e03 [azmedien:show] Improve _VALID_URL 2017-01-23 02:30:29 +07:00
Gaetan Gilbert 30dda24de3 [chirbit] Extract uploader 2017-01-23 02:27:38 +07:00
Sergey M․ 271808b6b2
[pornflip] Improve and extract dash formats (closes #11795) 2017-01-22 03:43:27 +07:00
einstein95 8d1fbe0cb2
[pornflip] Add extractor (closes #11556) 2017-01-22 03:41:59 +07:00
Sergey M․ a243abb80d
[chaturbate] Improve (closes #11797) 2017-01-22 03:02:48 +07:00
einstein95 42697bab3c
[chaturbate] Fix extraction 2017-01-22 02:58:40 +07:00
Sergey M․ 94629e537f
[azmedien] Improve (closes #11784) 2017-01-22 02:17:39 +07:00
Alex Seiler e84495cd8d
[azmedien] Add extractor (closes #11785) 2017-01-22 02:17:39 +07:00
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
ha shao 04a3d4d234
[vimeo:channel] Extract videos' titles for playlist entries 2017-01-21 23:37:44 +07:00
Sergey M․ 12afdc2ad6
[youtube] Extract episode metadata (closes #9695, closes #11774) 2017-01-21 18:10:32 +07:00
Yen Chi Hsuan f3c21cb7a7
[cspan] Fix _TESTS 2017-01-20 22:27:13 +08:00
Yen Chi Hsuan 972efe60c3
[generic] Remove a dead test 
The web page does not contain a video anymore

Ref: #2694, #2696
 2017-01-20 22:27:13 +08:00
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos 
Closes #11547
 2017-01-20 22:27:13 +08:00
Yen Chi Hsuan d77ac73790
[ustream] Add UstreamIE._extract_url() 
Ref: #11547
 2017-01-20 22:27:13 +08:00
Sergey M․ 1fe84be0f3
[1tv] Add support for hls (closes #11786) 2017-01-20 00:47:04 +07:00
james mike dupont cccd70a275 untie 2017-01-19 04:18:13 -05:00
Sergey M․ eb3f008c9e
[uol] Fix extraction (closes #11770) 2017-01-19 04:49:31 +07:00
Sergey M․ f1e70fc2ff
[mtv] Relax triforce feed regex (closes #11766) 2017-01-18 23:34:11 +07:00
Remita Amine baa3e1845b [bilibili] fix extraction(closes #11077) 2017-01-18 17:00:15 +01:00
Sergey M․ aaf2b7c57a
[canalplus] Add fallback for video id (closes #11764) 2017-01-18 22:20:11 +07:00
Sergey M․ b687c85eab
[extractor/generic] Add support for 20 minuten embeds (closes #11683, closes #11751) 2017-01-18 22:17:47 +07:00
Sergey M․ 538b17a09c
[20min] Improve 2017-01-18 22:17:41 +07:00
Alex Seiler 4e44598547
[20min] Fix extraction 2017-01-18 22:17:34 +07:00
Sergey M․ 136078966b
[imdb] Extend _VALID_URL (closes #11744) 2017-01-17 23:14:07 +07:00
Sergey M․ 8a5f0a6357
[naver] Update tests for #11743 2017-01-17 21:19:57 +07:00
Kagami Hiiragi c0bd51c090 [naver] Support tv.naver.com links 2017-01-17 21:15:50 +07:00
Sergey M․ 79fc8496c6
[xiami] Improve extraction (closes #11699) 
* Relax _VALID_URLs
* Improve track metadata extraction
 2017-01-16 23:31:50 +07:00
Sergey M․ 906420cae3
[limelight] Improve and make more robust (closes #11737) 
+ Add support for direct http for videos hosted on video.llnw.net
* Check handmade http URLs
 2017-01-16 21:54:47 +07:00
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID 
Closes #11688
 2017-01-16 00:06:52 +08:00
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies 
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
 2017-01-15 22:51:54 +08:00
Yen Chi Hsuan 8e4988f1a2
[niconico] Remove codes for downloading anonymously 
Apparently Niconico now blocks playing without an account

Closes #11170
 2017-01-15 22:10:57 +08:00
Sergey M․ a7acf868a5
[yourupload] Fix extraction (closes #11601) 2017-01-15 10:34:39 +07:00
Sergey M․ af62de104f
[beam:live] Improve and simplify (#10702, closes #11596) 2017-01-15 06:07:35 +07:00
sh!zeeg cd55c6ccd7
[beam:live] Add extractor 2017-01-15 06:06:10 +07:00
Sergey M․ 621a2800ca
[vevo] Improve geo restriction detection 2017-01-15 04:42:05 +07:00
Sergey M․ b80e2ebc8d
[dramafever] Add support for URLs with language code (#11714) 2017-01-14 18:27:22 +07:00
Remita Amine 99d537a5e0 [ooyala] fix typo 2017-01-14 07:12:50 +01:00
Sergey M․ abe8cb763f
[cbc] Improve playlist support (closes #11704) 2017-01-14 08:30:00 +07:00
Jakub Wilk 4f66c16f33 [brightcove:legacy] Fix misplaced backslash in a regexp 2017-01-14 06:26:11 +07:00
Sergey M․ e54fc0524e
[cmt] Add support for video-clips 2017-01-14 06:23:24 +07:00
Sergey M․ adf063dad1
[mtv,cc,cmt,spike] Improve and refactor 
- Eliminate _transform_rtmp_url
* Generalize triforce mgid extraction
+ [cmt] Add support for full-episodes (closes #11623)
 2017-01-14 06:18:38 +07:00
Remita Amine 5e8eebb600 [mitele] extract dash formats 2017-01-13 23:06:59 +01:00
Remita Amine 9837cb7507 [ooyala] add support for videos with embedToken(#11684) 2017-01-13 23:06:59 +01:00
Sergey M․ fb6a59205e
[mixcloud] Fix extraction (closes #11674) 2017-01-13 23:56:16 +07:00
Vijay Singh 06e9363b7a
[openload] Fix extraction (closes #10408) 
Just a minor fix for openload
 2017-01-13 23:40:19 +07:00
Remita Amine 1f393a3241 [tv4] improve extraction(closes #11698) 
- remove check for requires_subscription
- extract more formats
- extract subtitles
 2017-01-13 10:21:37 +01:00
Remita Amine c4251b9aaa [common] add possibility to customize akamai manifest host 2017-01-13 10:21:36 +01:00
Sergey M․ 3a407e707a
[freesound] Improve and remove unrelated metadata (closes #11608) 2017-01-12 23:03:53 +07:00
sh!zeeg ed06da4e7b
[freesound] Fix extraction and extended (closes #11602) 2017-01-12 22:35:14 +07:00
Sergey M․ 365d136b7c
[vimeo] Fix tests 2017-01-11 22:57:08 +07:00
Sergey M․ 1fd0fc42bd
[vimeo:ondemand] Fix test (closes #11651) 2017-01-11 22:51:03 +07:00
Sergey M․ 10cd2003b4
[nick] Add support for beta.nick.com (closes #11655) 2017-01-10 22:32:34 +07:00
Sergey M․ cdd11c0540
[mtv] Use native hls by default 2017-01-10 22:31:20 +07:00
Sergey M․ 67fc365b86
[mtv,cc] Use hls by default (closes #11641) 2017-01-10 22:30:47 +07:00
Sergey M․ 20faad74b6
[mtv] Fix non-hls extraction 
method attribute may not be present
 2017-01-10 22:27:23 +07:00
Sergey M․ 2032d935d1
[mtv] Add default value for use_hls 
These methods are used across codebase with old number of arguments
 2017-01-10 22:25:33 +07:00
Sergey M․ 366b759a60
[inc] Improve (closes #11647) 2017-01-09 23:08:59 +07:00
Déstin Reed 7f0bdc7a31
[inc] Add extractor 2017-01-09 22:57:14 +07:00
Sergey M․ 022a5d663b
[youtube] Add test for itag 212 (#11575) 2017-01-09 22:30:46 +07:00
Kacper Michajłow 8409b3683c [youtube] Add itag 212 
Seen on video with id 1t24XAntNCY
 2017-01-09 22:29:03 +07:00
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists 
Individual egghead videos are already handled by the generic/Wistia extractors.
 2017-01-09 11:24:40 +01:00
Sergey M․ 364131584b
[hitrecord] Improve (closes #11626) 2017-01-08 20:17:18 +07:00
J 553c68bbd9
[hitrecord] Add extractor 2017-01-08 20:17:18 +07:00
Remita Amine 827961b122 [videott] remove extractor 2017-01-07 14:47:36 +01:00
Remita Amine a5eefc492b [swrmediathek] skip tests correctly 2017-01-06 15:09:10 +01:00
Remita Amine a9cd1691b2 [swrmediathek] improve extraction 2017-01-06 15:06:08 +01:00
Remita Amine 2365f94412 [sharesix] remove extractor 2017-01-06 13:56:58 +01:00
Remita Amine 32b7c2a57e [aol] remove AolFeaturesIE 2017-01-06 12:10:47 +01:00
Remita Amine 221ce32529 [break] merge BreakIE and ScreenJunkiesIE 2017-01-06 11:25:48 +01:00
Remita Amine e5dfdc8164 [sendtonews] improve info extraction 2017-01-06 11:23:43 +01:00
Remita Amine a814da3f62 [skynews] update test 2017-01-06 11:22:35 +01:00
Sergey M․ b2727d0bee
[3sat,phoenix] Fix extraction (closes #11619) 2017-01-06 17:13:53 +07:00
Philipp Hagemeister dbaf601646 [comedycentral/mtv] Add support for HLS videos (fixes #11600) 
Currently, the HTTP files of the RTMP urls are not present for the The Daily Show.
Use HLS instead for now.
 2017-01-05 22:36:07 +01:00
Yen Chi Hsuan ec85ded83c
Fix "invalid escape sequences" error on Python 3.6 2017-01-06 00:58:56 +08:00
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing 
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
 2017-01-05 18:50:34 +08:00
Sergey M․ fb47cb5b23
[zdf] Improve (closes #11055, closes #11063) 2017-01-05 04:05:27 +07:00
Paul Hartmann b6de53ea8a
[zdf] Fix extraction 2017-01-05 04:04:53 +07:00
Sergey M․ 96d315c2be
[pornhub:playlist] Improve extraction (closes #11594) 2017-01-04 05:32:18 +07:00
Sergey M․ 1911d77d28
[cctv] Add support for ncpa-classic.com (closes #11591) 2017-01-04 01:30:40 +07:00
Sergey M․ 027e231295
[tunein] Add support for embeds (closes #11579) 2017-01-03 01:45:59 +07:00
Sergey M․ 7a9e066972
[cctv] Relax some video id regexes 2017-01-03 01:13:02 +07:00
Sergey M․ 3783a5ccba
[cctv] Relax _VALID_URL 2017-01-02 23:18:44 +07:00
Sergey M․ 327caf661a
[cctv] Do not fallback on video id extracted from URL 2017-01-02 23:00:37 +07:00
Sergey M․ ce7ccb1caa
[cctv] Improve and merge with cntv (closes #879, closes #6753, closes #8541) 2017-01-02 22:55:24 +07:00
RPing 295eac6165
[cntv] Add extractor 2017-01-02 22:55:19 +07:00
Sergey M․ 966815e139
[nrktv:episodes] Add support for episodes (#11571) 2017-01-01 21:26:32 +07:00
Sergey M․ 1f766b6e7b
[arkena] Add support for video.arkena.com (closes #11568) 2017-01-01 02:46:47 +07:00
Sergey M․ 3f1ce16876
[twitch:vod] Improve _VALID_URL (closes #11537) 2016-12-31 22:40:42 +07:00
Robert Smith 9a0f999585
[twitch] Added support for player.twitch.tv URLs (closes #11535) 2016-12-31 22:32:49 +07:00
Sergey M․ e186a9ec03
[videa] Add support for videa embeds 2016-12-31 22:05:32 +07:00
Sergey M․ 69677f3ee2
[videa] Improve and simplify (closes #8181, closes #11133) 2016-12-31 22:05:32 +07:00
Bagira e746021577
[videa] Add extractor 2016-12-31 22:05:32 +07:00
Sergey M․ 424ed37ec4
[vk] Fix postlive videos extraction 2016-12-30 04:31:19 +07:00
Sergey M․ 9cdb0a338d
[vk] Extract from playerParams (closes #11555) 2016-12-30 04:21:49 +07:00
Sergey M․ 6cf261d882
[freevideo] Remove extractor (closes #11515) 
Handled by generic extractor
 2016-12-30 00:32:23 +07:00
Sergey M․ df086e74e2
[showroomlive] Improve (closes #11458) 2016-12-30 00:12:35 +07:00
Arjan Verwer 963bd5ecfc
[showroomlive] Add extractor 2016-12-29 23:17:00 +07:00
Sergey M․ 51378d359e
[xhamster] Fix duration extraction (closes #11549) 2016-12-28 23:04:46 +07:00
Sergey M․ b63005f5af
[rtve:live] Fix extraction (closes #11529) 2016-12-25 04:02:29 +07:00
Yen Chi Hsuan 4606c34e19 [extractor/common] Allow non-lang in subtitles' keys 
See 264e77c406
 2016-12-25 01:50:50 +08:00
Sergey M․ 53a664edf4
[brightcove:legacy] Improve embeds detection (closes #11523) 2016-12-24 22:46:27 +07:00
Sergey M․ 264e77c406
[twitch] Add support for rechat messages (closes #11524) 2016-12-24 22:10:54 +07:00
Mattias Wadman 846fd69bac [acast] Add test with multiple blings 2016-12-24 14:28:30 +01:00
Mattias Wadman 12da830993 [acast] Fix broken audio URL and timestamp extraction 
Before first bling was used now we look for the first bling with
type BlingAudio.

Before publishingDate was a ms unix timestamp now it is iso8601.
 2016-12-24 14:28:30 +01:00
Remita Amine a07588369f [common] improve detection for video only formats and m3u8 manifest(fixes #11507) 2016-12-22 10:02:56 +01:00
Remita Amine f5a723a78a [theplatform] pass geo verification headers to smil request(closes #10146) 2016-12-21 20:59:03 +01:00
Remita Amine f120646f04 [viu] pass geo verification headers to auth request 2016-12-21 20:50:10 +01:00
Remita Amine 9c5b5f2115 [rtl2] extract more formats and metadata 2016-12-21 18:46:25 +01:00
Sergey M․ ae806db628
[vbox7] Skip malformed JSON-LD (closes #11501) 2016-12-21 22:39:05 +07:00
Remita Amine bfa1073e11 [uplynk] force downloading using hls native downloader(closes #11496) 2016-12-20 19:49:45 +01:00
Remita Amine e029c43bd4 [laola1] add support for another extraction scenario(closes #11460) 2016-12-20 18:22:57 +01:00
Sergey M․ 3d6761ba92
[vbox7] Fix extraction (closes #11494) 2016-12-20 21:53:51 +07:00
Remita Amine f59d1146c0 [uktvplay] Add new extractor(closes #11027) 2016-12-20 12:52:46 +01:00
Remita Amine b1c357975d [piksel] Add new extractor(closes #11246) 2016-12-20 12:35:03 +01:00
Remita Amine d8c507c9e2 [vimeo] fix extraction for hls formats and add support for dash formats(closes #11490) 2016-12-20 12:35:03 +01:00
Remita Amine 7fe1592073 [common] fix dash codec information for mixed videos and fragment url construction(#11490) 2016-12-20 12:35:03 +01:00
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․ c80db5d398
[nrktv:direkte] Add support for live streams (#11488) 2016-12-19 23:47:45 +07:00
Remita Amine 5aaf012a4e [pbs] fix extraction for geo restricted videos(#7095) 2016-12-19 16:27:12 +01:00
Remita Amine 954529c10f [brightcove:new] skip widevine classic videos 2016-12-18 21:39:59 +01:00
Remita Amine ed7b333fbf [viu] extract supported hls manifest 2016-12-18 18:24:01 +01:00
Remita Amine 723103151e [viu] improve extraction(closes #10607)(closes #11329) 2016-12-18 17:20:53 +01:00
ping e7b6caef24 [viu] New extractor for viu.com 2016-12-18 17:20:53 +01:00
Remita Amine 199a47abba [ccma] Add new extractor(closes #11359) 2016-12-18 10:49:10 +01:00
Remita Amine b42a0bf360 [laola1tv] add support embed urls and improve extraction(#11460) 2016-12-17 21:48:45 +01:00
Remita Amine 6e416b210c [nbc] fix extraction for msnbc videos(fixes #11466) 2016-12-17 18:11:13 +01:00
Sergey M․ 04bf59ff64
[extractors] Add missing twitch imports 2016-12-17 23:03:50 +07:00
Sergey M․ 87a449c1ed
[extractor/common] Recognize DASH formats in html5 media entries 2016-12-17 23:03:13 +07:00
Sergey M․ 93753aad20
[twitch] Adapt to new videos pages schema (closes #11469) 2016-12-17 20:20:23 +07:00
Sergey M․ 2786818c33
[meipai] Fix regular videos extraction and improve (closes #10718) 2016-12-17 19:42:34 +07:00
Philip Xu 9b785768ac
[meipai] Add extractor 2016-12-17 19:41:35 +07:00
Sergey M․ 47c914f995
[ondemandkorea] Fix extraction (closes #10772) 2016-12-17 18:50:12 +07:00
Sergey M․ 732d116aa7
[jwplatform] Improve duration extraction 2016-12-17 18:50:07 +07:00
Sergey M․ a495840d3b
[jwplatform] Improve subtitles extraction 2016-12-17 18:50:00 +07:00
ping 594601f545
[ondemandkorea] Add extractor 2016-12-17 18:49:45 +07:00
Sergey M․ 0ae9560eea
[vporn] Use urljoin for thumbnail 2016-12-16 23:57:51 +07:00
Remita Amine dc1f3a9f20 [vvvvid] do not cache the conn_id 2016-12-16 11:05:46 +01:00
Remita Amine 7b1e80792b [vvvvid] Add new extractor(closes #5915) 2016-12-16 09:05:34 +01:00
Yen Chi Hsuan 5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan 30918999f5
[facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Sergey M․ 069f918302
[vlive] Use live titles for live streams 2016-12-14 21:30:33 +07:00
Sergey M․ 89c63cc5f8
[vlive] Add video params extraction fallback and improve (closes #11375) 2016-12-14 21:05:50 +07:00
Corey Nicholson 577748075b
[vlive] Update extraction 2016-12-14 21:05:32 +07:00
Remita Amine 67dcbc0add [canvas] extract dash formats 2016-12-13 17:59:22 +01:00
Sergey M․ 3a40f859b5
[melonvod] Improve (closes #11419) 2016-12-13 02:27:26 +07:00
ping abf3494ac7
[melonvod] Add extractor for vod.melon.com 2016-12-13 02:13:40 +07:00
Sergey M․ 3530e0d3d9
[dplay] Use Safari user-agent for hls (closes #11418) 2016-12-12 00:58:08 +07:00
Sergey M․ d2d2495e16
[facebook] Detect login required error message 2016-12-11 01:40:30 +07:00
Sergey M․ 19b4900b7b
[facebook] Improve video selection (closes #11390) 2016-12-11 01:22:01 +07:00
Sergey M․ 6ca478d44a
[canalplus] Add another video id regex (closes #11399) 2016-12-11 00:45:27 +07:00
Sergey M․ 655cb545ab
[mixcloud] Relax _VALID_URL (closes #11406) 2016-12-10 23:48:18 +07:00
Remita Amine f0b69fa91a [ctvnews] relax _VALID_URL regex(closes #11394) 2016-12-10 17:36:32 +01:00
Remita Amine 8821a718cf [common] recognize hls manifests that contain video only formats(#11394) 2016-12-10 17:22:15 +01:00
Remita Amine 0d7d9f9404 [rte] improve extraction(closes #10498)(closes #7746) 2016-12-10 16:34:01 +01:00
Remita Amine f41db40596 [prosiebensat1] extract dash formats 2016-12-10 13:29:51 +01:00
Remita Amine 68601ef3ac [rts,srgssr] improve extraction for geo restricted videos(fixes #11089)(closes #4989) 2016-12-10 10:47:56 +01:00
Yen Chi Hsuan 6c20a0bb99
[openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Sergey M․ f43795e56b
[pandoratv] PEP 8 and simplify 2016-12-07 23:50:10 +07:00
Serkora 7441915b1e [pandoratv] Fix extraction (closes #11023) 2016-12-07 23:46:42 +07:00
Remita Amine 283d1c6a8b [telebruxelles] extract all formats and add support for emission urls 2016-12-06 19:01:17 +01:00
Sergey M․ 875ddd7409
[bloomberg] Add another video id regex (closes #11371) 2016-12-06 00:41:03 +07:00
Sergey M․ 4afa4ff223
[1tv] Fix video id extraction 2016-12-05 23:28:57 +07:00
vordep 3ed81714d8
[fusion] Update ooyala id regex 2016-12-05 22:43:36 +07:00
Sergey M․ 9b5288c92a
[1tv] Improve extraction and add support for playlists (closes #11335) 2016-12-04 23:35:21 +07:00
Remita Amine a94e7f4a0c [aenetworks] extract more formats(closes #11321) 2016-12-01 12:15:35 +01:00
Yen Chi Hsuan d17bfe4095
[thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS 
Closes #11271
 2016-12-01 14:56:52 +08:00
Sergey M․ 4c4765dba2
[soundcloud] Update client id (closes #11327) 2016-11-30 23:17:30 +07:00
Philipp Hagemeister f882554815 [comedcycentral] Give /shows/.+/full-episodes URLs to the COmedyCentralFullEpisodesIE 2016-11-30 11:52:19 +01:00
Sergey M․ db75f14d8a
[ruutu] Detect DRM videos 2016-11-30 04:19:38 +07:00
Sergey M․ 8b0d3ee64e
[liveleak] Simplify and PEP 8 2016-11-29 23:42:19 +07:00
Varun 3779d524df [liveleak] Add support for youtube embeds 2016-11-29 23:37:30 +07:00
Mark Lee 6303fc8204 [spike] Fix full episodes extraction 2016-11-29 23:06:01 +07:00
Philipp Hagemeister cc61fc3934 [comedycentral] Add new extractor for full-episodes 
CC seems to have added yet another indirection for full episodes - the mgid is now only in a linked feed.
This may be a little brittle, but it's better than failing outright.
Plus, the current The Daily Show episode now works :)
 2016-11-29 10:12:18 +01:00
Sergey M․ c2530d3319
[teamfourstar] Simplify _VALID_URL and relax regexes 2016-11-28 23:22:29 +07:00
felix 8953319916 [screenwavemedia] Remove extractor 
Rewrite TeamFourStar and Normalboots extractors in terms of JWPlatform
 2016-11-28 23:17:56 +07:00
Sergey M․ 83f1481baa
[extractor/generic] Add support for webcaster.pro embeds 2016-11-27 19:56:32 +07:00
Sergey M․ f25e1c8d8c
[webcaster] Add support for webcaster.pro 2016-11-27 19:54:59 +07:00
Sergey M․ 6901673868
[azubu] Add support for azubu.uol.com.br (closes #11305) 2016-11-27 15:40:28 +07:00
Sergey M․ 560c8c6ec0
[viki] Prefer hls 2016-11-26 00:14:09 +07:00
Sergey M․ 9338a0eae3
[viki] Fix rtmp formats extraction (closes #11255) 2016-11-26 00:13:46 +07:00
Sergey M․ 74394b5e10
[puls4] Relax _VALID_URL (closes #11267) 2016-11-25 23:37:32 +07:00
Sergey M․ 1db058466d
[vevo] Allow video info to fail in tests 2016-11-24 23:10:58 +07:00
Sergey M․ e94eeb1dd3
[vevo] Simplify artists extraction 2016-11-24 23:09:35 +07:00
Andrew J. Erickson 8b27d83e4e
vevo: fixing naming when there are featured artists 2016-11-24 23:07:28 +07:00
Sergey M․ 8eb7b5c3f1
[mitele] Modernize and extract more metadata 2016-11-24 22:43:02 +07:00
zurfyx b68599ed47
[mitele] Relax _VALID_URL 2016-11-24 21:57:53 +07:00
Yen Chi Hsuan 44444f0d3b
[cbslocal] Support newyork.cbslocal.com 
Closes #11285
 2016-11-24 20:32:17 +08:00
Sergey M․ c867adc68c
[youtube:playlist] Pass disable_polymer in query (closes #11193, closes #11270) 2016-11-23 23:28:32 +07:00
Andy Savicki 868630fbe5
[hellporno] Add support for hellporno.net and improve ext extraction 2016-11-22 22:16:10 +07:00
Yen Chi Hsuan 1d6ae5628f
[amcnetworks] Recognize more BBC America URLs 
Closes #11263
 2016-11-22 20:40:57 +08:00
Sergey M․ 6334794f2a
[funnyordie] Copy formats' metadata from hls and sort formats 2016-11-21 23:46:55 +07:00
Andy Savicki 4eece8ba57
[funnyordie] Improve extraction 2016-11-21 22:16:26 +07:00
Sergey M․ 8f8f182d0b
[extractor/generic] Improve limelight embeds support 2016-11-20 02:13:21 +07:00
Yen Chi Hsuan fb27d0ce5e
Merge branch 'master' of https://github.com/DarkstaIkers/youtube-dl into DarkstaIkers-master 2016-11-20 00:05:11 +08:00
Sergey M․ 0aacd2deb1
[bandcamp] Fix free downloads extraction and extract all formats (closes #11067) 2016-11-19 04:18:21 +07:00
Sergey M․ df46b19cb8
[toutv] Fix login form regex (closes #11223) 2016-11-19 01:56:31 +07:00
Sergey M․ 748a462fbe
[twitter:card] Relax _VALID_URL (closes #11225) 2016-11-19 01:49:13 +07:00
Sergey M․ c131fc3372
[tvanouvelles] Add extractor (closes #10616) 2016-11-18 01:16:33 +07:00
Sergey M․ 073d5bf583
[youtube:live] Relax _VALID_URL (closes #11164) 2016-11-16 23:15:19 +07:00
Yen Chi Hsuan eceba9f805 Merge pull request #11122 from kasper93/openload 
[openload] Fix extraction.
 2016-11-16 20:43:19 +08:00
Sergey M․ 58355a3bf1
[vlive] Add test for #11203 2016-11-15 22:11:47 +07:00
ping 49b69ad91c [vlive] Prefer locale over language for subtitles id 2016-11-15 22:07:17 +07:00
felix a0758dfa1a [filmon] new extractor 2016-11-13 17:28:17 +01:00
Sergey M․ 50913b8241
[nrk] Improve geo restriction detection 2016-11-13 22:29:36 +07:00
Sergey M․ 7e08e2cab0
[nrk] Add X-Forwarded-For HTTP header in info dict 2016-11-13 22:28:29 +07:00
Sergey M․ 754e6c8322
[nrk] Workaround geo restriction and improve error messages 2016-11-13 20:54:34 +07:00
Sergey M․ e58609b22c
[afreecatv] Add support for vod.afreecatv.com (closes #11174) 2016-11-13 06:02:26 +07:00
Sergey M․ 4ea4c0bb22
[extractor/common] Fix Bandwidth substitution in media template (closes #11175) 2016-11-13 05:43:34 +07:00
Kacper Michajłow 577281b0c6
[cda] Fix and improve extraction 
Fixes #10929
 2016-11-13 01:01:29 +07:00
Sergey M․ 3d2729514f
[plays] Improve extraction and add support for embed URLs 2016-11-12 23:08:05 +07:00
Sergey M․ f076d7972c
[extractor/common] Improve thumbnail extraction from JSON-LD 2016-11-12 23:01:05 +07:00
cpm 8b1aeadc33
[plays] Fix extraction 2016-11-12 22:59:39 +07:00
Kacper Michajłow 95ad9ce573 [openload] Fix extraction. 
aadecode code was restored from commit c1decda58c
with some optimizations (2x faster).

Fixes #10408
 2016-11-11 15:36:57 +01:00
Sergey M․ bc40b3a5ba
[eagleplatform] Fix extraction (closes #11160) 2016-11-11 03:26:29 +07:00
Yen Chi Hsuan 3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Sergey M․ 4719af097c
[extractors] Add forgotten import for espn:article 2016-11-08 22:27:02 +07:00
Sergey M․ 9946aa5ccf
[franceculture] Fix extraction (closes #11140) 2016-11-08 22:26:33 +07:00
Yen Chi Hsuan 5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
Sergey M․ ebc7ab1e23
[espn] Fix extraction (closes #11041) 2016-11-08 00:29:12 +07:00
DarkZeros cb882540e8 [mitele] Fix extraction after website redesign (fixes #10824) 2016-11-07 11:13:59 +01:00
Sergey M․ 98708e6cbd
[ard] Remove age restriction check (closes #11129) 2016-11-06 23:20:15 +07:00
Sergey M․ b52c9ef165
[extractor/generic] Improve support for pornhub embeds (closes #11100) 2016-11-06 21:52:00 +07:00
Sergey M․ e28ed498e6
[extractor/generic] Add support for redtube embds (closes #11099) 2016-11-06 21:42:41 +07:00
Sergey M․ 5021ca6c13
[redtube] Add support for embed URLs 2016-11-06 21:39:29 +07:00