Commit graph

8606 commits

Author SHA1 Message Date
Sergey M․ 8804f10e6b
[tube8] Modernize 2016-08-17 05:46:45 +07:00
Sergey M․ 6be17c0870
[mofosex] Extract all formats and modernize (Closes #10335) 2016-08-17 05:45:49 +07:00
Sergey M․ 8652770bd2
[keezmovies] Improve and modernize 2016-08-17 05:44:46 +07:00
Sergey M․ 2a1321a272
[vbox7:generic] Add support for vbox7 embeds 2016-08-17 01:02:59 +07:00
Sergey M․ 9c0fa60bf3
[vbox7] Add support for embed URLs 2016-08-17 00:42:02 +07:00
Sergey M․ 502d87c546
[mtg] Improve view count extraction 2016-08-17 00:32:28 +07:00
Sergey M․ b35b0d73d8
[viafree] Add extractor (Closes #10358) 2016-08-17 00:21:30 +07:00
Sergey M․ 6e7e4a6edf
[mtg] Add support for viafree URLs (#10358) 2016-08-17 00:19:43 +07:00
Remita Amine 53fef319f1 [fxnetworks] extend _VALID_URL to support simpsonsworld.com 2016-08-16 16:22:34 +01:00
Remita Amine 2cabee2a7d [amcnetworks] fix typo 2016-08-16 16:22:34 +01:00
Remita Amine 11f502fac1 [theplatform] extract subtitles with multiple formats from the metadata 2016-08-16 16:22:34 +01:00
Sergey M․ 98affc1a48
[xvideos] Fix test 2016-08-16 21:20:15 +07:00
Sergey M․ 70a2829fee
[xvideos] Fix HLS extraction (Closes #10356) 2016-08-16 21:17:52 +07:00
Remita Amine 837e56c8ee [amcnetworks] extract episode metadata 2016-08-16 14:49:32 +01:00
Remita Amine b5ddee8c77 [amcnetworks] Add new extractor 2016-08-16 13:44:01 +01:00
Sergey M․ fb64adcbd3
[adobepass] PEP 8 2016-08-16 04:45:21 +07:00
Sergey M․ 4f640f2890
[bbc:playlist] Fix tests 2016-08-16 04:43:10 +07:00
Sergey M․ 254e64a20a
[bbc:playlist] Add support for pagination (Closes #10349) 2016-08-16 04:36:23 +07:00
Remita Amine 818ac213eb [adobepass] add IE suffix to the extractor and remove duplicate constant 2016-08-15 21:36:34 +01:00
Remita Amine cbef4d5c9f [fxnetworks] add test and check geo restriction 2016-08-15 17:10:45 +01:00
Remita Amine bf90c46790 [fxnetworks] Add new extractor(closes #9462) 2016-08-15 16:34:32 +01:00
Yen Chi Hsuan 69eb4d699f
[cbsnews] Remove invalid tests. CBS Live videos gets deleted soon. 2016-08-15 20:29:22 +08:00
Yen Chi Hsuan 760845ce99
[cbslocal] Adapt to SendtoNewsIE 2016-08-15 13:37:37 +08:00
Yen Chi Hsuan 5c2d087221
[sendtonews] Fix extraction 2016-08-15 13:31:08 +08:00
Yen Chi Hsuan b6c4e36728
[jwplatform] Parse video_id from JWPlayer data
And remove a mysterious comma from 115c65793a
2016-08-15 13:29:01 +08:00
Sergey M․ 1a57b8c18c
[zippcast] Remove extractor (Closes #10332)
ZippCast is shut down
2016-08-15 08:25:24 +07:00
Remita Amine 24eb13b1c6 [uplynk,viceland] update tests and change uplynk extractors names 2016-08-14 22:45:43 +01:00
Remita Amine 525e0316c0 [adobepass] fix check for pendingLogout errors 2016-08-14 21:25:43 +01:00
Remita Amine 7e60ce9cf7 [adobepass] clear cache in case of pendingLogout errors 2016-08-14 21:24:33 +01:00
Remita Amine e811bcf8f8 [viceland] raise ExtractorError for errors other than HTTP 400 2016-08-14 20:13:35 +01:00
Remita Amine 6103f59095 [viceland] remove outdated comment 2016-08-14 19:08:35 +01:00
Remita Amine 9fa5789279 [viceland] fix info extraction(closes #8799) 2016-08-14 19:04:23 +01:00
Remita Amine d2ac04674d [viceland] Add new extractor(#8799) 2016-08-14 18:04:50 +01:00
Remita Amine 1fd6e30988 [adobepass] create separate class for adobe pass authentication 2016-08-14 18:04:50 +01:00
Sergey M․ 884cdb6cd9
[life:embed] Improve extraction 2016-08-14 20:49:11 +07:00
Remita Amine 9771b1f901 [theplatform] use _get_netrc_login_info and fix session expiration check(#10345) 2016-08-14 11:55:28 +01:00
Remita Amine 2118fdd1a9 [common] add separate method for getting netrc ligin info 2016-08-14 11:55:28 +01:00
Sergey M․ 320d597c21
[vgtv] Detect geo restricted videos (#10348) 2016-08-14 16:25:14 +07:00
Remita Amine aaf44a2f47 [uplynk] Add new extractor 2016-08-13 22:53:41 +01:00
phi 097eba019d bug fix for extractor xiami.py
Before applying this patch, when downloading resources from xiami.com, it crashes with these:
Traceback (most recent call last):
  File "/home/phi/.local/bin/youtube-dl", line 11, in <module>
    sys.exit(main())
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 433, in main
    _real_main(argv)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 423, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1786, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 691, in extract_info
    ie_result = ie.extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 347, in extract
    return self._real_extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 116, in _real_extract
    return self._extract_tracks(self._match_id(url))[0]
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 43, in _extract_tracks
    '%s/%s%s' % (self._API_BASE_URL, item_id, '/type/%s' % typ if typ else ''), item_id)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 562, in _download_json
    json_string, video_id, transform_source=transform_source, fatal=fatal)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 568, in _parse_json
    return json.loads(json_string)
  File "/usr/lib/python3.5/json/__init__.py", line 312, in loads
    s.__class__.__name__))
TypeError: the JSON object must be str, not 'NoneType'

This patch solves exactly this problem.
2016-08-14 02:18:59 +08:00
Sergey M․ 5ec5461e1a
[pbs] Clarify comment on http formats 2016-08-13 22:50:18 +07:00
Sergey M․ 542130a5d9
[pbs] Fix description extraction and update tests 2016-08-13 21:59:29 +07:00
Sergey M․ 82997dad57
[franceculture] Fix extraction (Closes #10324) 2016-08-13 21:00:34 +07:00
Sergey M․ 647a7bf5e8
[pornotube] Fix extraction (Closes #10322) 2016-08-13 20:49:16 +07:00
Sergey M․ 77afa008dd
[4tube] Fix metadata extraction (Closes #10321) 2016-08-13 19:55:09 +07:00
Yen Chi Hsuan db535435b3
[bigflix] Remove an invalid test
There's no video anymore
2016-08-13 18:02:11 +08:00
Sergey M․ c2a453b461
[imgur] Fix width and height extraction (Closes #10325) 2016-08-13 16:46:07 +07:00
Sergey M․ cd29eaab95
[vbox7] Remove unused imports 2016-08-13 16:45:34 +07:00
Sergey M․ e97c55ee6a
[expotv] Improve extraction and update test 2016-08-13 16:29:05 +07:00
Sergey M․ cb55908e51
[vbox7] Fix extraction (Closes #10309) 2016-08-13 15:47:20 +07:00
Yen Chi Hsuan e581224843
[tapely] Remove extractor. It's shut down
Closes #10323
2016-08-13 16:32:07 +08:00
Remita Amine f50365e91c [pbs] add test for videos with undocumented http formats and remove unused import 2016-08-13 09:10:09 +01:00
Sergey M․ c366f8d30a
[24video] Add support for me and xxx TLDs 2016-08-13 14:47:51 +07:00
Sergey M․ 6a26c5f9d5
[muenchentv] Fix extraction (Closes #10313) 2016-08-13 14:28:44 +07:00
Sergey M․ bd6fb007de
[24video] Fix comment count extraction 2016-08-13 14:22:47 +07:00
Sergey M․ b69b2ff736
[sunporno] Add support for embed URLs 2016-08-13 14:13:49 +07:00
Sergey M․ 794e5dcd7e
[sunporno] Fix metadata extraction (Closes #10316) 2016-08-13 14:09:35 +07:00
Remita Amine f0d3669437 [hgtv] Add new extractor(closes #3999) 2016-08-12 18:05:49 +01:00
Remita Amine 3cddb8d6a7 [pbs] check all http formats and remove unnecessary request
- some of the quality that not reported in the documentation
are available(4500k, 6500k)
- the videoInfo request doesn't work for a long time
2016-08-12 08:38:06 +01:00
Sergey M․ 990d533ee4
[crunchyroll] Add support for HLS (Closes #10301) 2016-08-12 00:56:16 +07:00
Sergey M․ a3be69b7f0
[viu] Remove from extractors 2016-08-12 00:14:51 +07:00
Sergey M․ 0fd1b1624c
[goldenmoustache] Remove extractor (Closes #10298)
Now uses dailymotion
2016-08-11 23:52:17 +07:00
Sergey M․ 367976d49f
[drtuber] Improve title extraction 2016-08-11 23:47:52 +07:00
Sergey M․ 0aef0771f8
[drtuber] Make dislike count optional (Closes #10297) 2016-08-11 23:47:27 +07:00
Sergey M․ 0c070681c5
[chirbit] Fix extraction (Closes #10296) 2016-08-11 23:37:56 +07:00
Sergey M․ 30b25d382d
[francetvinfo] Relax _VALID_URL 2016-08-11 21:42:55 +07:00
Sergey M․ 7f2ed47595
[rtlnl] Relax _VALID_URL (Closes #10282) 2016-08-10 21:07:43 +07:00
Sergey M․ c3fa77bdef
[formula1] Relax _VALID_URL (Closes #10283) 2016-08-10 21:00:40 +07:00
Remita Amine 57ce8a6d08 [wat] improve extraction(#10281)
add alternative method to extract http formats
works even if the video is geo-restricted or removed
from public access(most of the cases)
2016-08-10 14:20:28 +01:00
Yen Chi Hsuan 69d8eeeec5
[ctsnews] Fix extraction 2016-08-10 11:38:38 +08:00
Remita Amine 20ef4123b9 [uol] remove unused import 2016-08-09 15:13:15 +01:00
Remita Amine 4e62d26aa2 [uol] Add new extractor(#4263) 2016-08-09 15:09:08 +01:00
Sergey M․ 3a380766d1
[rbmaradio] Improve, simplify and extract all formats (Closes #10242) 2016-08-09 02:46:29 +07:00
Petr Zvoníček affaea0688
[rbmaradio] Fixed extractor 2016-08-09 02:18:33 +07:00
Sergey M․ 77426a087b
[sonyliv] Improve (Closes #10258) 2016-08-09 02:16:28 +07:00
Sukhbir Singh 8991844ea2
[sonyliv] Add new extractor 2016-08-09 02:09:13 +07:00
Sergey M․ 082395d0a0
[extractor/generic] Add proper default to _search_json_ld call 2016-08-08 22:48:33 +07:00
Sergey M․ e8ed7354e6
[flipagram] Add proper default to _search_json_ld call 2016-08-08 22:46:19 +07:00
Sergey M․ 1e7f602e2a
[condenast] Make _search_json_ld call non fatal 2016-08-08 22:45:49 +07:00
Sergey M․ 522f6c066d
[bbc] Add proper default to _search_json_ld call 2016-08-08 22:44:36 +07:00
Sergey M․ 321b5e082a
[extractor/common] Respect default in _search_json_ld 2016-08-08 22:36:18 +07:00
Sergey M․ 3711fa1eb2
Revert "[flipagram] Make _search_json_ld non fatal"
This reverts commit d34995a9e3.
2016-08-08 21:49:45 +07:00
Sergey M․ 395c74615c
Revert "[extractor/generic] Make _search_json_ld non fatal"
This reverts commit 958849275f.
2016-08-08 21:49:27 +07:00
Yen Chi Hsuan 3dc240e8c6
[sohu] Update _TESTS (closes #10260) 2016-08-08 18:48:21 +08:00
Yen Chi Hsuan a41a6c5094
[chaturbate] Skip the invalid test 2016-08-08 13:06:02 +08:00
Yen Chi Hsuan d71207121d
[biqle] Skip an invalid test 2016-08-08 12:59:55 +08:00
Yen Chi Hsuan b1c6f21c74
[aparat] Fix extraction 2016-08-08 12:59:07 +08:00
Yen Chi Hsuan 412abb8760
[bilibili] Update _TESTS 2016-08-08 12:57:17 +08:00
Yen Chi Hsuan f17d5f6d14
[features.aol.com] Fix _TESTS 2016-08-08 12:52:36 +08:00
Remita Amine 6bb801cfaf [cwtv] extract http formats 2016-08-07 22:58:12 +01:00
Sergey M․ de02d1f4e9
[rozhlas] Fix regexes and improve extraction (Closes #10253) 2016-08-08 04:58:02 +07:00
Petr Zvoníček e1f93a0a76
[rozhlas] Add new extractor 2016-08-08 04:41:45 +07:00
Yen Chi Hsuan b2bd968f4b
[kuwo:singer] Fix extraction 2016-08-07 22:59:34 +08:00
Sergey M․ d92cb46305
[discoverygo] Add extractor (Closes #10245) 2016-08-07 20:57:05 +07:00
Sergey M․ d34995a9e3
[flipagram] Make _search_json_ld non fatal 2016-08-07 19:06:55 +07:00
Sergey M․ 958849275f
[extractor/generic] Make _search_json_ld non fatal 2016-08-07 19:04:22 +07:00
Sergey M․ 998f094452
[bbc] Remove proxy from test 2016-08-07 18:13:05 +07:00
Sergey M․ aaa42cf0cf
[bbc] PEP 8 2016-08-07 18:05:13 +07:00
Sergey M․ 9fb64c04cd
[bbc] Add support for morph embeds (Closes #10239) 2016-08-07 18:01:50 +07:00
Remita Amine f9622868e7 [bbc] preserve format_id backward compatibility 2016-08-07 11:14:15 +01:00
Remita Amine 37768f9242 [common] correctly lower the preference of m3u8 master manifest format 2016-08-07 10:59:09 +01:00
Sergey M․ a1aadd09a4
[tnaflixnetworkbase] Improve title extraction 2016-08-07 16:00:09 +07:00
Sergey M․ b47a75017b
[tnaflix] Fix metadata extraction (Closes #10249) 2016-08-07 16:00:03 +07:00
Remita Amine e37b54b140 [fox] fix theplatform release url query 2016-08-06 20:53:39 +01:00
Yen Chi Hsuan c1decda58c
[openload] Fix extraction (closes #9706) 2016-08-07 02:44:15 +08:00
Remita Amine ad152e2d95 [bbc] fix test 2016-08-06 19:36:12 +01:00
Remita Amine b0af12154e [bbc] reduce requests and improve format_id 2016-08-06 19:24:59 +01:00
Remita Amine d16b3c6677 [common] extract partOfTVSeries info in json-ld 2016-08-06 18:58:38 +01:00
Remita Amine c57244cdb1 [common] lower the preference of m3u8 master manifest format 2016-08-06 18:55:05 +01:00
Remita Amine a7e5f27412 [bbc] improve extraction
- extract f4m and dash formats
- improve format sorting and listing
- improve extraction of articles with `otherSettings.playlist`
2016-08-06 18:48:09 +01:00
Remita Amine 089a40955c [pokemon] improve _VALID_URL 2016-08-06 12:08:14 +01:00
Remita Amine d73ebac100 [pokemon] Add new extractor(closes #10093) 2016-08-06 11:18:14 +01:00
Remita Amine e563c0d73b [condenast] fallback to loader.js if video.js fail 2016-08-05 21:01:16 +01:00
Sergey M․ 8122e79fef
[gamekings] Remove remnants 2016-08-06 00:12:37 +07:00
Sergey M․ fe3ad1d456
[adultswim] Remove superfluous md5 from test 2016-08-06 00:02:05 +07:00
Sergey M․ 038a5e1a65
[adultswim] Add support for trailers (Closes #10235) 2016-08-06 00:00:05 +07:00
Sergey M․ 84bc23b41b
[archiveorg] PEP 8 2016-08-05 23:16:19 +07:00
Sergey M․ 46933a15d6
[extractor/common] Support root JSON-LD lists (Closes #10203) 2016-08-05 23:14:32 +07:00
Sergey M․ 3859ebeee6
[tvplay] Capture and output native error message 2016-08-05 22:50:42 +07:00
Remita Amine d50aca41f8 [archiveorg] improve format extraction(closes #10219) 2016-08-05 16:42:15 +01:00
Remita Amine 0ca057b965 [jwplatform] add support for playlist extraction and relative urls and improve audio detection 2016-08-05 16:42:15 +01:00
Sergey M․ 5ca968d0a6
[tvplay] Extract series metadata 2016-08-05 22:37:38 +07:00
Sergey M․ f0d31c624e
[tvplay] Add support for subtitles (Closes #10194) 2016-08-05 22:17:32 +07:00
Remita Amine 08c655906c [5min] fix _VALID_URL(closes #10228) 2016-08-05 10:22:33 +01:00
Remita Amine 5a993e1692 [natgeo] fix tests(closes #10229) 2016-08-05 10:13:26 +01:00
Remita Amine a7d2953073 [extractors] add tvp:embed import 2016-08-05 10:11:59 +01:00
Remita Amine fdd0b8f8e0 [tvp] extract video id from the webpage(fixes #7799) 2016-08-05 09:44:15 +01:00
Remita Amine f65dc41b72 [naver] extract upload date 2016-08-05 08:12:25 +01:00
Yen Chi Hsuan 962250f7ea
[cbslocal] Fix timestamp parsing (closes #10213) 2016-08-05 11:44:50 +08:00
Remita Amine b02b960c6b [naver] improve extraction(closes #8096) 2016-08-04 21:42:22 +01:00
Remita Amine 4f427c4be8 [condenast] improve extraction 2016-08-04 18:30:56 +01:00
Sergey M․ 8a00ea567b
[natgeo:episodeguide] Do not shadow url from outer scope 2016-08-04 23:21:04 +07:00
Remita Amine 8895be01fc [5min] fix _VALID_URL 2016-08-04 16:55:12 +01:00
Remita Amine 52e7fcfeb7 [engadget] Relax _VALID_URL 2016-08-04 16:34:47 +01:00
Remita Amine 2396062c74 [5min] delegate extraction to AolIE
recently the 5min SenseHandler request return
HTTP Error 503: Service Unavailable error
2016-08-04 16:21:27 +01:00
Remita Amine 14704aeff6 [kaltura] remove debugging line 2016-08-04 14:54:34 +01:00
Remita Amine 3c2c3af059 [extractors] change imports for national geographic extractors 2016-08-04 12:20:56 +01:00
Remita Amine 1891ea2d76 [nationalgeographic] Add support for National Geographic Episode Guide 2016-08-04 12:18:10 +01:00
Remita Amine 1094074c04 [kaltura] extract subtitles and reduce requests 2016-08-04 09:39:06 +01:00
Remita Amine 217d5ae013 [vodplatform] Add new extractor 2016-08-04 09:39:06 +01:00
Remita Amine 8b40854529 [common] lower proto_preference of rtsp formats
Most of the time the RtspFD fail to download videos but it report
success of the download with this output:
[mpv] 0 bytes
[download] 100% of 0.00B
2016-08-04 09:39:06 +01:00
Sergey M․ 8d3b226b83
[gamekings] Remove extractor
Now covered by generic jwplayer
2016-08-03 22:06:10 +07:00
Remita Amine 42b7a5afe0 [limelight] extract http formats 2016-08-03 13:12:51 +01:00
Sergey M․ 9cb0e65d7e
[ntvru] Fix extraction 2016-08-02 22:56:48 +07:00
Sergey M․ b070564efb
[extractor/common] Support multiple properties in _og_search_property 2016-08-02 22:55:14 +07:00
Philipp Hagemeister 6a9b3b61ea [comedycentral] Re-add shortnames
In cc99d4f826, the shortname feature got deleted by accident. Re-add it as a separate IE.
2016-08-02 14:02:31 +02:00
Sergey M․ e03d3e6453
[cwtv] Add support for cwtvpr.com (Closes #10196) 2016-08-01 22:51:01 +07:00
Remita Amine a70e45f80a [limelight] keep videos marked as previewStream
e382b953f0 (commitcomment-18472915)
2016-08-01 16:25:41 +01:00
Sergey M․ 697655a7c0
[safari] Relax url regexes (Closes #10202) 2016-08-01 21:48:48 +07:00
Remita Amine e382b953f0 [limelight] skip preview and drm protected videos 2016-08-01 00:33:30 +01:00