Commit graph

18204 commits

Author SHA1 Message Date
nixxo d53fec697e
[mailru] fixed extraction
improved valid_url regex to match more urls like
>https://my.mail.ru/mail/7bw7/video/embed/_myvideo/6778
>https://videoapi.my.mail.ru/videos/embed/mail/7bw7/_myvideo/6778.html
previously not matched.

Fixed json extraction to download metadata and video url.
2020-09-07 14:21:21 +02:00
xarantolus c4a1d0eef8 Merge branch 'fixYTSearch' of https://github.com/xarantolus/youtube-dl into fixYTSearch 2020-09-06 09:25:02 +02:00
xarantolus bea9b00588 Fix regex for other variable declaration type
This now supports declarations like `window["ytInitialData"] = ...` and `var ytInitialData = ...`
2020-09-06 09:22:49 +02:00
xarantolus f442082a50 [youtube] More general title extraction
Seems like this attribute is moved every few weeks, so we just extract both and use the one that is present.
2020-09-06 09:22:48 +02:00
xarantolus 1f93faf60b [youtube] Make ytcfg.set config extraction non-fatal
If the markup of the page changes in the future, it might be possible that _FEED_DATA still works, but the other regex does not. SInce it is not necessary for the first page of videos, we make sure the program doesn't exit before extracting them.

TL;DR: Extract the first video page even if there are problems
2020-09-06 09:22:47 +02:00
xarantolus 299056ad52 Fix python2 compatibility and title extraction 2020-09-06 09:22:47 +02:00
xarantolus f536080701 Run formatter 2020-09-06 09:22:46 +02:00
xarantolus 5c430b67bd [youtube] Fix feed extraction
In order to extract videos from further pages, we need to get various variables that are in an argument to the `ytcfg.set` call in a script on the feed page.
2020-09-06 09:22:46 +02:00
xarantolus e03b4f3e05 [youtube] Make search extraction less dependent on json schema.
If an object looks like a video (it has a `videoId` key), assume that it is.
2020-09-06 09:22:30 +02:00
xarantolus 19f671f88b [youtube] Move search URL extraction to appropriate extractor 2020-09-06 09:21:26 +02:00
xarantolus b948643f9c [youtube] Fix extraction of search urls (closes ytdl-org/youtube-dl#25696) 2020-09-06 09:21:25 +02:00
Sergey M․ d51e23d9fc
release 2020.09.06 2020-09-06 13:00:41 +07:00
Sergey M․ 6cd452acff
[ChangeLog] Actualize
[ci skip]
2020-09-06 12:57:56 +07:00
Sergey M․ 50e9fcc1fd
[nrktv:episode] Improve video id extraction (closes #25594, closes #26369, closes #26409) 2020-09-06 12:43:50 +07:00
Unknown 2045de7c32 [skip travis] bump version 2020-09-06 07:36:49 +02:00
random-nick 16ee69c1b7
[youtube] Fix age gate content detection (#26100) (closes #26152, closes #26311, closes #26384) 2020-09-06 11:44:53 +07:00
Sergey M․ 67171ed7e9
[youtube:user] Extend _VALID_URL (closes #26443) 2020-09-06 11:31:28 +07:00
Unknown 419da738f3 [skip travis] exe related 2020-09-06 06:20:23 +02:00
Sergey M․ 1d9bf655e6
[utils] Recognize wav mimetype (closes #26463) 2020-09-06 11:19:53 +07:00
TheRealDude2 62ae19ff76
[xhamster] Improve initials regex (#26526) (closes #26353) 2020-09-06 11:10:27 +07:00
Sergey M․ 5ed05f26ad
[svtplay] Fix svt id extraction (closes #26425, closes #26428, closes #26438) 2020-09-06 10:45:57 +07:00
Sergey M․ 841b683804
[twitch] Rework extractors (closes #12297, closes #20414, closes #20604, closes #21811, closes #21812, closes #22979, closes #24263, closes #25010, closes #25553, closes #25606)
* Switch to GraphQL.
+ Add support for collections.
+ Add support for clips and collections playlists.
2020-09-06 10:45:34 +07:00
Tom-Oliver Heidel 81e7a77e59 Merge branch 'julien-hadleyjack-ondemandkorea' 2020-09-06 04:02:47 +02:00
Tom-Oliver Heidel 65f5a72266 Merge branch 'ondemandkorea' of https://github.com/julien-hadleyjack/youtube-dl into julien-hadleyjack-ondemandkorea 2020-09-06 04:02:43 +02:00
Unknown bc842c27a7 flake8 fix + soundcloud tests 2020-09-06 02:57:08 +02:00
Tom-Oliver Heidel ea40ffd1e1 Merge branch 'MrDoritos-mkvthumbnail' 2020-09-06 02:43:42 +02:00
Tom-Oliver Heidel 3c0c0b428d Merge branch 'mkvthumbnail' of https://github.com/MrDoritos/youtube-dl into MrDoritos-mkvthumbnail 2020-09-06 02:43:37 +02:00
Tom-Oliver Heidel 115c360536 Merge branch 'adrianheine-abc' 2020-09-06 02:39:08 +02:00
Tom-Oliver Heidel a74727e93c Merge branch 'abc' of https://github.com/adrianheine/youtube-dl into adrianheine-abc 2020-09-06 02:39:04 +02:00
Unknown b54d0e702a Merge remote-tracking branch 'origin/master' 2020-09-06 02:37:51 +02:00
Tom-Oliver Heidel 27e248cdcd
Merge pull request #48 from theincognito-inc/master
[hotstar] Move to API v1
2020-09-06 02:28:53 +02:00
Tom-Oliver Heidel d788bb9724 Merge branch 'zubearc' 2020-09-06 01:52:42 +02:00
Tom-Oliver Heidel 9aa79d6460 Merge branch 'master' of https://github.com/zubearc/youtube-dl into zubearc 2020-09-06 01:52:20 +02:00
zubearc 8848f8083b [test/youtube] update subtitle tests 2020-09-05 17:56:28 -04:00
NotFound 7078ec64b3 [hotstar] Move to API v1 2020-09-06 03:04:08 +05:30
Tom-Oliver Heidel b3b710e2a8 Merge branch 'LucBerge-deezer' 2020-09-05 19:40:03 +02:00
Tom-Oliver Heidel 51f8793699 Merge branch 'deezer' of https://github.com/LucBerge/youtube-dl into LucBerge-deezer 2020-09-05 19:40:01 +02:00
Tom-Oliver Heidel 45edec2fb3 Merge branch 'mrtnmtth-wdr-subtitles' 2020-09-05 19:37:47 +02:00
Tom-Oliver Heidel 47b9774231 Merge branch 'wdr-subtitles' of https://github.com/mrtnmtth/youtube-dl into mrtnmtth-wdr-subtitles 2020-09-05 19:37:36 +02:00
Tom-Oliver Heidel 42eceaac7d
Merge pull request #38 from blackjack4494/soundcloud-sets
[soundcloud] sets pattern and tests
2020-09-04 02:08:23 +02:00
zubearc 7e1cf1a48d support new json3 captions 2020-09-03 19:24:31 -04:00
Unknown 906f980a75 [soundcloud] sets pattern and tests
include tests (weekly + charts)
weekly with login worked before. but now also public weekly will work. charts and similar patterned sets as well
2020-09-04 00:57:37 +02:00
xarantolus 4c47858c05 Fix regex for other variable declaration type
This now supports declarations like `window["ytInitialData"] = ...` and `var ytInitialData = ...`
2020-09-03 20:41:45 +02:00
Tom-Oliver Heidel c10f38f887 Merge branch 'TinyToweringTree-tvnow' 2020-09-03 18:19:57 +02:00
Tom-Oliver Heidel e908c55c9f Merge branch 'tvnow' of https://github.com/TinyToweringTree/youtube-dl into TinyToweringTree-tvnow 2020-09-03 18:19:36 +02:00
Unknown 633c2852fb [skip travis] twitch release. 2020-09-03 17:11:38 +02:00
Tom-Oliver Heidel 5627160298 Merge branch 'lel-amri-twitch-fix' 2020-09-03 17:06:26 +02:00
Tom-Oliver Heidel dac4ecf592 Merge branch 'twitch-fix' of https://github.com/lel-amri/youtube-dl into lel-amri-twitch-fix 2020-09-03 17:05:58 +02:00
Tom-Oliver Heidel 2028c6492a
[skip travis] quick fix readme 2020-09-03 06:06:48 +02:00
Tom-Oliver Heidel 424dc7be53
[skip travis] add pypi badge 2020-09-03 06:06:19 +02:00