mirrors/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-11-30 12:01:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
22126 commits 3 branches 100 tags 92 MiB
Commit graph

3336 commits

Author SHA1 Message Date
Franklin Lee db97438940
[ie/PicartoVod] Fix extractor (#7727) 
Closes #2926
Authored by: Frankgoji
 2023-08-01 18:21:16 +00:00
ifan-t b9de629d78
[ie/S4C] Add extractor (#7730) 
Authored by: ifan-t
 2023-08-01 18:01:59 +00:00
ringus1 a854fbec56
[ie/facebook] Add dash manifest URL (#7743) 
Fixes #7742
Authored by: ringus1
 2023-08-01 19:43:54 +05:30
ischmidt20 30b29f3715
[ie/fox] Support foxsports.com (#7724) 
Authored by: ischmidt20
 2023-08-01 12:54:04 +05:30
Steve 6d6081dda1
[extractor/pbs] Add extractor PBSKidsIE (#7602) 
Authored by: snixon
Fixes #2440
 2023-07-31 22:38:37 +05:30
bashonly 6014355c61
[ie/twitter] Add fallback, improve error handling (#7621) 
Closes #7579, Closes #7625
Authored by: bashonly
 2023-07-29 23:37:06 +00:00
pukkandan f73c118035
FFmpegFixupM3u8PP may need to run with ffmpeg 
Bug in 62b5c94cad
Closes #7725
 2023-07-30 04:24:46 +05:30
coletdjnz 546b2c28a1
[ie/youtube] Fix player_params arg being converted to lowercase 
Fix bug in ba06d77a31

Authored by: coletdjnz
 2023-07-30 10:50:25 +12:00
pukkandan 6148833f5c
[cleanup] Misc 2023-07-30 04:06:18 +05:30
pukkandan 8cb7fc44db
Fix --check-formats 
Bug in bc344cd456
 2023-07-30 03:23:13 +05:30
pukkandan 3f7965105d
[utils] HTTPHeaderDict: Handle byte values 2023-07-30 03:18:10 +05:30
bashonly b09bd0c196
[ie/tiktok] Fix audio-only format extraction (#7712) 
Closes #6608
Authored by: bashonly
 2023-07-29 16:14:16 +00:00
bashonly 127a224606
[ie/LBRY] Fix original format extraction (#7711) 
Authored by: bashonly
 2023-07-29 16:01:43 +00:00
bashonly 86eeb044c2
[ie/hotstar] Support /clips/ URLs (#7710) 
Closes #7699
Authored by: bashonly
 2023-07-29 15:47:43 +00:00
bashonly 9a04113dfb
[ie/Reddit] Fix thumbnail extraction 
Authored by: bashonly
 2023-07-29 10:30:32 -05:00
coletdjnz ba06d77a31
[ie/youtube] Add player_params extractor arg (#7719) 
Authored by: coletdjnz
 2023-07-29 06:20:42 +00:00
coletdjnz 4bf912282a
[networking] Remove dot segments during URL normalization (#7662) 
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.

Closes #3355, #6526

Authored by: coletdjnz
 2023-07-28 22:40:20 +00:00
nnoboa a15fcd299e
[ie/Wimbledon] Add extractor (#7551) 
Closes #7462
Authored by: nnoboa
 2023-07-28 18:52:07 +00:00
Amirreza Aflakparast c03a58ec99
[ie/MotorTrendOnDemand] Update _VALID_URL (#7683) 
Closes #7680
Authored by: AmirAflak
 2023-07-28 18:51:16 +00:00
coletdjnz bbeacff7fc
[networking] Ignore invalid proxies in env (#7704) 
Authored by: coletdjnz
 2023-07-27 20:26:02 +05:30
bashonly dae349da97
[ie/WrestleUniversePPV] Fix HLS AES key extraction 
Fix bug in ef8fb7f029

Closes #7708
Authored by: bashonly
 2023-07-27 09:53:22 -05:00
bashonly 550e65410a
[ie] Extract subtitles from SMIL manifests (#7667) 
Authored by: bashonly, pukkandan
 2023-07-24 00:09:52 +00:00
bashonly 39837ae319
[ie/triller] Fix unlisted video extraction (#7670) 
Authored by: bashonly
 2023-07-23 23:29:45 +00:00
coletdjnz 86aea0d3a2
[networking] Add strict Request extension checking (#7604) 
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-07-23 05:17:15 +00:00
bashonly 11de6fec9c
[ie/PatreonCampaign] Fix extraction (#7664) 
Authored by: bashonly
 2023-07-22 13:10:25 +00:00
pukkandan a250b24733
[compat] Ensure submodules are imported correctly 
Closes #7663
 2023-07-22 18:10:35 +05:30
pukkandan 25b6e8f946
Fix e0c4db04dc for pypy 2023-07-22 10:17:36 +05:30
pukkandan e705738338
[ie/unsupported] List more sites with DRM 
Closes #7323, #3072, #5740, #5767, #6125
 2023-07-22 09:56:56 +05:30
pukkandan 62b5c94cad
[cleanup] Misc fixes 
Closes #7528
 2023-07-22 09:09:52 +05:30
pukkandan e0c4db04dc
[compat] Add types.NoneType 2023-07-22 09:00:45 +05:30
pukkandan 81b4712bca
[extractor] Fix --load-pages 2023-07-22 09:00:44 +05:30
pukkandan 994f7ef8e6
[ie/generic] Fix generic title for embeds 
Closes #7067
 2023-07-22 08:57:44 +05:30
pukkandan a264433c9f
[outtmpl] Fix replacement for playlist_index 2023-07-22 08:57:43 +05:30
pukkandan 9f66247289
[ie/abematv] Temporary fix for protocol handler 
Closes #7622
 2023-07-22 08:57:42 +05:30
bashonly e57eb98222
[fd/external] Fix ffmpeg input from stdin (#7655) 
Bugfix for 1ceb657bdd

Authored by: bashonly
 2023-07-22 02:32:49 +00:00
Simon Sawicki 9b16762f48
[ie/crunchyroll] Remove initial state extraction (#7632) 
Authored by: Grub4K
 2023-07-20 22:09:52 +02:00
bashonly 65cfa2b057
[ie/MuseAI] Add extractor (#7614) 
Closes #7543
Authored by: bashonly
 2023-07-20 14:15:21 +00:00
bashonly f4ea501551
[ie/MagellanTV] Add extractor (#7616) 
Closes #7529
Authored by: bashonly
 2023-07-20 14:02:50 +00:00
bashonly af86873218
[utils] Improve parse_duration 
Authored by: bashonly
 2023-07-20 08:40:31 -05:00
bashonly 75dc8e673b
[networking] Fix --legacy-server-connect (#7645) 
Bugfix for 227bf1a33b

Authored by: bashonly
 2023-07-20 13:31:17 +00:00
bashonly 71baa490eb
[networking] Fix POST requests with zero-length payloads (#7648) 
Bugfix for 227bf1a33b

Authored by: bashonly
 2023-07-20 13:23:30 +00:00
bashonly 613dbce177
[ie/twitter:spaces] Fix format protocol (#7550) 
Closes #7536
Authored by: bashonly
 2023-07-15 21:10:12 +00:00
Văn Anh bb5d84c9d2
[ie/facebook:reel] Fix extraction (#7564) 
Closes #7469
Authored by: demon071, bashonly
 2023-07-15 21:03:23 +00:00
zhong-yiyu 1d3d579c21
[ie/pornhub] Update access cookies for UK (#7591) 
Closes #7590
Authored by: zhong-yiyu
 2023-07-15 20:54:19 +00:00
bashonly 42ded0a429
[fd/external] Fixes to cookie handling 
- Fix bug in `axel` Cookie header arg
- Pass cookies to `curl` as strings
- Write session cookies for `aria2c` and `wget`

Closes #7539
Authored by: bashonly
 2023-07-15 15:25:51 -05:00
bashonly 6c5211cebe
[core] Fix HTTP headers and cookie handling 
- Remove `Cookie` header from `http_headers` immediately after loading into cookiejar
- Restore compat for `--load-info-json` cookies
- Add more tests
- Fix improper passing of Cookie header by `MailRu` extractor

Closes #7558
Authored by: bashonly, pukkandan
 2023-07-15 15:25:45 -05:00
Aaruni Kaushik 2b029ca0a9
[cleanup] Add color to download-archive message (#5138) 
Authored by: aaruni96, Grub4K, pukkandan
Closes #4913
 2023-07-16 00:45:08 +05:30
pukkandan 131d132da5
[build] Make sure deprecated modules are added 2023-07-15 16:47:55 +05:30
coletdjnz 3d2623a898
[compat, networking] Deprecate old functions (#2861) 
Authored by: coletdjnz, pukkandan
 2023-07-15 16:18:35 +05:30
coletdjnz 227bf1a33b
[networking] Rewrite architecture (#2861) 
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.

User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
   - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`

Authored by: coletdjnz
 2023-07-15 16:18:35 +05:30
pukkandan c365dba843
[networking] Add module (#2861) 
No actual changes - code is only moved around
 2023-07-15 16:18:34 +05:30
pukkandan 1b392f905d
[utils] Add temporary shim for logging 
Related: #5680, #7517
 2023-07-15 16:18:34 +05:30
coletdjnz 1ba6fe9db5
[ie/youtube:tab] Detect looping feeds (#6621) 
Closes https://github.com/yt-dlp/yt-dlp/issues/5555

Note: the first page may still be repeated, however this is better than nothing.

Authored by: coletdjnz
 2023-07-15 03:20:24 +00:00
Finn R. Gärtner 1bcb9fe871
[ie/piapro] Support /content URL (#7592) 
Authored by: FinnRG
 2023-07-14 23:39:02 +05:30
Neurognostic 8a4cd12c8f
[pp/EmbedThumbnail] Support m4v (#7583) 
Authored by: Neurognostic
 2023-07-14 02:09:21 +05:30
Aleri Kaisattera 2cfe221fbb
[ie/streamanity] Remove (#7571) 
Service is dead
Authored by: alerikaisattera
 2023-07-13 19:47:05 +05:30
Mahmoud Abdel-Fattah 2af4eeb772
[utils] clean_podcast_url: Handle more trackers (#7556) 
Authored by: mabdelfattah, bashonly
Closes #7544
 2023-07-11 06:30:38 +05:30
Zprokkel 325191d0c9
[ie/vrt] Update token signing key (#7519) 
Authored by: Zprokkel
 2023-07-10 13:15:47 +00:00
GD-Slime bdd0b75e3f
[ie/BiliBiliBangumi] Fix extractors (#7337) 
- Overhaul BiliBiliBangumi extractor for the site's new API
- Add BiliBiliBangumiSeason extractor
- Refactor BiliBiliBangumiMedia extractor

Closes #6701, Closes #7400
Authored by: GD-Slime
 2023-07-08 22:26:03 +00:00
bashonly 92315c0377
[extractor/twitter] Fix GraphQL and legacy API (#7516) 
Authored by: bashonly
 2023-07-06 19:39:51 +00:00
pukkandan b03fa78345
Revert 49296437a8 2023-07-06 14:19:32 -05:00
github-actions cc0619f62d Release 2023.07.06 
Created by: pukkandan

:ci skip all :ci run dl
 2023-07-06 18:57:59 +00:00
Simon Sawicki 3121512228
[core] Change how Cookie headers are handled 
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: Grub4K
 2023-07-06 23:14:39 +05:30
coletdjnz f8b4bcc0a7
[core] Prevent Cookie leaks on HTTP redirect 
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: coletdjnz
 2023-07-06 23:14:39 +05:30
bashonly 1ceb657bdd
[fd/external] Scope cookies 
- ffmpeg: Calculate cookies from cookiejar and pass with `-cookies` arg instead of `-headers`
- aria2c, curl, wget: Write cookiejar to file and use external FD built-in cookiejar support
- httpie: Calculate cookies from cookiejar instead of `http_headers`
- axel: Calculate cookies from cookiejar and disable http redirection if cookies are passed
    - May break redirects, but axel simply don't have proper cookie support

Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj

Authored by: bashonly, coletdjnz
 2023-07-06 23:14:38 +05:30
pukkandan ad8902f616
[ie/vidlii] Handle relative URLs 
Closes #7480
 2023-07-06 21:40:09 +05:30
pukkandan 94ed638a43
[ie/youtube] Avoid false DRM detection (#7396) 
Some master manifests contain a mix of DRM and non-DRM formats
 2023-07-06 21:40:07 +05:30
pukkandan bc344cd456
[core] Allow extractors to mark formats as potentially DRM (#7396) 
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.

Makes the error message when using `--test` inconsistent,
but doesn't really matter.
 2023-07-06 21:40:01 +05:30
pukkandan 906c0bdcd8
[formats] Fix best fallback for storyboards 
Partial fix for #7478
 2023-07-06 21:39:58 +05:30
pukkandan 337734d4a8
[cleanup] Misc 2023-07-06 21:39:55 +05:30
pukkandan 47bcd43724
[outtmpl] Pad playlist_index etc even when with internal formatting 
Closes #7501
 2023-07-06 20:22:03 +05:30
pukkandan 662ef1e910
[downloader/http] Avoid infinite loop when no data is received 
Closes #7504
 2023-07-06 20:22:00 +05:30
coletdjnz 90db9a3c00
[extractor/youtube:stories] Remove (#7459) 
YouTube killed them

https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
 2023-07-06 19:02:41 +05:30
bashonly 49296437a8
[extractor/twitter] Fix unauthenticated extraction (#7476) 
Closes #7473
Authored by: bashonly
 2023-07-05 16:27:36 +00:00
bashonly 1cffd621cb
[extractor/twitter:spaces] Fix extraction (#7512) 
Closes #7455
Authored by: bashonly
 2023-07-05 03:05:52 +00:00
RfadnjdExt 3b7f5300c5
[extractor/googledrive] Fix source format extraction (#7395) 
Closes #7344
Authored by: RfadnjdExt
 2023-07-05 02:17:13 +00:00
coletdjnz 4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default (#7475) 
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.

Closes https://github.com/yt-dlp/yt-dlp/issues/7474

Authored by: coletdjnz
 2023-07-03 10:47:10 +00:00
c-basalt 8776349ef6
[extractor/vk] VKPlay, VKPlayLive: Add extractors (#7358) 
Closes #7107
Authored by: c-basalt
 2023-07-02 19:31:00 +00:00
urectanc af1fd12f67
[extractor/stacommu] Add extractors (#7432) 
Authored by: urectanc
 2023-06-30 18:27:07 +00:00
coletdjnz fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists (#7425) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-06-29 23:26:27 +00:00
bashonly a2be9781fb
[extractor/Douyin] Fix extraction from webpage 
Closes #7431
Authored by: bashonly
 2023-06-27 16:50:02 -05:00
Xiao Han 8f05fbae2a
[extractor/abc] Fix extraction (#7434) 
Closes #6433
Authored by: meliber
 2023-06-27 21:16:57 +00:00
Aman Salwan 5b4b92769a
[extractor/crunchyroll:music] Fix _VALID_URL (#7439) 
Closes #7419
Authored by: AmanSal1, rdamas

Co-authored-by: Robert Damas <robert.damas@byom.de>
 2023-06-27 20:28:23 +00:00
pukkandan 91302ed349
[utils] clean_podcast_url: Handle protocol in redirect URL 
Closes #7430
 2023-06-26 16:19:49 +05:30
pukkandan f393bbe724
[extractor/sbs] Python 3.7 compat 
Closes #7410
 2023-06-26 16:14:20 +05:30
pukkandan 8a8af356e3
[downloader/aria2c] Add --no-conf 
Closes #7404
 2023-06-26 16:13:31 +05:30
pukkandan d949c10c45
[extractor/youtube] Process post_live over 2 hours 2023-06-26 07:25:52 +05:30
bashonly ef8509c300
[extractor/kick] Fix _VALID_URL 
Closes #7384
Authored by: bashonly
 2023-06-25 17:04:42 -05:00
nnoboa 5e16cf92eb
[extractor/AdultSwim] Extract subtitles from m3u8 (#7421) 
Authored by: nnoboa
Closes #6191
 2023-06-26 01:52:38 +05:30
bashonly f0a1ff1181
[extractor/qdance] Add extractor (#7420) 
Closes #7385
Authored by: bashonly
 2023-06-25 18:13:28 +00:00
pukkandan 58786a10f2
[extractor/youtube] Add extractor-arg formats 
Closes #7417
 2023-06-25 20:14:37 +05:30
pukkandan e59e20744e
Bugfix for b4e0d75848 2023-06-22 23:45:53 +05:30
Simon 89bed01374
[extractor/youtube] Fix comments' is_favorited (#7390) 
Authored by: bbilly1
Closes #7389
 2023-06-22 23:38:42 +05:30
github-actions de4cf77ec1 Release 2023.06.22 
Created by: pukkandan

:ci skip all :ci run dl
 2023-06-22 08:09:31 +00:00
pukkandan 812cdfa06c
[cleanup] Misc 2023-06-22 13:31:07 +05:30
pukkandan cd810afe2a
[extractor/youtube] Improve nsig function name extraction 2023-06-22 13:27:18 +05:30
pukkandan b4e0d75848
Improve --download-sections 
* Support negative time-ranges
* Add `*from-url` to obey time-ranges in URL

Closes #7248
 2023-06-22 13:03:07 +05:30
Berkan Teber 71dc18fa29
[extractor/youtube] Improve description parsing performance (#7315) 
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads

Authored by: pukkandan, berkanteber
 2023-06-22 12:57:54 +05:30
bashonly 98cb1eda7a
[extractor/rheinmaintv] Add extractor (#7311) 
Authored by: barthelmannk

Co-authored-by: barthelmannk <81305638+barthelmannk@users.noreply.github.com>
 2023-06-22 05:24:52 +00:00
bashonly 774aa09dd6
[extractor/dplay] GlobalCyclingNetworkPlus: Add extractor (#7360) 
* Allows `country` API param to be configured with `--xff`/`geo_bypass_country`

Closes #7324
Authored by: bashonly
 2023-06-22 05:16:39 +00:00
rexlambert22 f2ff0f6f19
[extractor/motherless] Add gallery support, fix groups (#7211) 
Authored by: rexlambert22
 2023-06-22 00:00:54 +00:00
pukkandan 5fd8367496
[extractor] Support multiple _VALID_URLs (#5812) 
Authored by: nixxo
 2023-06-22 03:19:55 +05:30
pukkandan 0dff8e4d1e
Indicate filesize approximated from tbr better 2023-06-22 01:37:55 +05:30
pukkandan 1e75d97db2
[extractor/youtube] Add ios to default clients used 
* IOS is affected neither by 403 or by nsig so helps mitigate them preemptively
* IOS also has higher bit-rate "premium" formats though they are not labeled as such
 2023-06-22 01:36:06 +05:30
pukkandan 81ca451480
[extractor/youtube] Workaround 403 for android formats 
Ref: https://github.com/TeamNewPipe/NewPipe/issues/9038#issuecomment-1289756816
 2023-06-22 00:15:22 +05:30
Roland Hieber 3f756c8c40
[extractor/nebula] Fix extractor (#7156) 
Closes #7017
Authored by: Lamieur, rohieb

Co-authored-by: Lam <github@Lam.pl>
 2023-06-21 08:29:34 +00:00
bashonly 7f9c6a63b1
[cleanup] Misc 
Authored by: bashonly
 2023-06-21 03:24:24 -05:00
OverlordQ db22142f6f
[extractor/dropout] Fix season extraction (#7304) 
Authored by: OverlordQ
 2023-06-21 07:17:07 +00:00
pukkandan d7cd97e8d8
Fix bug in db3ad8a676 
Closes #7367
 2023-06-21 12:13:27 +05:30
github-actions d1b2156149 Release 2023.06.21 
Created by: pukkandan

:ci skip all :ci run dl
 2023-06-21 04:02:40 +00:00
pukkandan 42f2d40b47
Update to ytdl-commit-07af47 
[YouTube] Improve fix for ae8ba2c
07af47960f
 2023-06-21 09:21:23 +05:30
pukkandan 1619ab3e67
Bugfix for ebe1b4e34f 2023-06-21 09:21:22 +05:30
pukkandan 84078a8b38
[core] Fix filepath being copied to underlying format dict 
Closes #6536
 2023-06-21 09:21:21 +05:30
pukkandan ad54c9130e
[cleanup] Misc 
Closes #6288, Closes #7197, Closes #7265, Closes #7353, Closes #5773
Authored by: mikf, freezboltz, pukkandan
 2023-06-21 09:21:20 +05:30
Nicolai Dagestad db3ad8a676
Add option --netrc-cmd (#6682) 
Authored by: NDagestad, pukkandan
Closes #1706
 2023-06-21 08:37:42 +05:30
MMM af7585c824
[extractor/tagesschau] Fix single audio urls (#6626) 
Authored by: flashdagger
 2023-06-21 08:14:12 +05:30
pukkandan 02948a17d9
[update] Do not restart into versions without --update-to 2023-06-21 06:10:40 +05:30
pukkandan 424f3bf033
[downloader/fragment] Do not sleep between fragments 
Closes #6599
 2023-06-21 06:10:39 +05:30
pukkandan ebe1b4e34f
[outtmpl] Fix some minor bugs 
Closes #7164
 2023-06-21 06:10:39 +05:30
pukkandan a35af4306d
[utils] strftime_or_none: Handle negative timestamps 
Closes #6706
Authored by pukkandan, dirkf
 2023-06-21 06:10:39 +05:30
pukkandan 93b39cdbd9
Add --compat-option playlist-match-filter 
Closes #6073
 2023-06-21 06:10:39 +05:30
pukkandan 97afb093d4
[extractor/youtube] Ignore wrong fps of some formats 2023-06-21 06:10:39 +05:30
pukkandan 2e023649ea
[cookies] Revert compatibility breakage in b38d4c941d 2023-06-21 06:10:38 +05:30
pukkandan 51a07b0dca
[extractor/youtube] Prioritize premium formats 
Closes #7283
 2023-06-21 06:10:38 +05:30
pukkandan eedda5252c
[utils] FormatSorter: Improve size and br 
Closes #1596

Previously, when some formats have accurate size and some approximate,
the ones with accurate size was always prioritized

For formats with known tbr and unknown vbr/abr, we were setting
(vbr=tbr, abr=0) for sorting to work. This is no longer needed.

Authored by pukkandan, u-spec-png
 2023-06-21 06:10:38 +05:30
Mozi 5cc09c004b
[extractor/zaiko] ZaikoETicket: Add extractor (#7347) 
Authored by: pzhlkj6612
 2023-06-20 04:22:36 +00:00
Vladislav 6f69101dc9
[extractor/yappy] YappyProfile: Add extractor (#7346) 
Authored by: 7vlad7
 2023-06-19 20:43:35 +00:00
garret 81c8b9bdd9
[extractor/nhk] NhkRadiruLive: Add extractor (#7332) 
Authored by: garret1317
 2023-06-19 13:25:27 +00:00
pukkandan 01aba2519a
[jsinterp] Fix global object extraction 
Closes #7327
 2023-06-18 04:11:15 +05:30
pukkandan 13ff780953
[postprocessor] Print newline for --progress-template 
Closes #7193
 2023-06-17 01:43:09 +05:30
pukkandan ff9b0e071f
[extractor/youtube] Determine audio language using automatic captions 2023-06-17 01:43:03 +05:30
toomyzoom 0a5d7c39e1
[extractor/iwara] Fix authentication (#7137) 
Closes #7035, Closes #7207
Authored by: toomyzoom
 2023-06-15 23:23:01 +00:00
TxI5 125ffaa173
[extractor/tv4] Fix extractor (#5649) 
Closes #5535
Authored by: TxI5, dirkf
 2023-06-15 17:57:25 +00:00
foreignBlade f9213f8a2d
[extractor/stripchat] Fix extractor (#7306) 
Closes #7305
Authored by: foreignBlade
 2023-06-15 10:56:26 +00:00
Jeong, Heon fdd69db389
[extractor/afreecatv] Fix extractor (#6283) 
Closes #6133
Authored by: blmarket
 2023-06-14 19:01:18 +00:00
Elyse 83465fc410
[extractor/ettutv] Add extractor (#6579) 
Closes #6359
Authored by: elyse0
 2023-06-14 18:54:06 +00:00
RjY 6daaf21092
[extractor/discogs] Add extractor (#6624) 
Authored by: rjy
 2023-06-14 18:40:06 +00:00
hoaluvn 7bcd481321
[extractor/urplay] Extract all subtitles (#7309) 
Authored by: hoaluvn
 2023-06-14 21:22:17 +05:30
bashonly c8561c6d03
[extractor/wrestleuniverse] Fix cookies support 
Closes #7298
Authored by: bashonly
 2023-06-13 15:49:18 -05:00
Cyberes cab94a0cd8
[extractor/funker530] Add extractor (#7291) 
Authored by: Cyberes
 2023-06-13 03:23:17 +00:00
c-basalt 345b4c0aed
[extractor/zaiko] Add extractor (#7254) 
Closes #7196
Authored by: c-basalt
 2023-06-12 18:12:09 +00:00
linsui 8790ea7b25
[extractor/ximalaya] Sort playlist entries (#7292) 
Authored by: linsui
 2023-06-12 13:32:50 +05:30
puc9 ab6057ec80
[extractor/tiktok] Fix resolution extraction (#7237) 
Authored by: puc9
 2023-06-11 18:57:59 +00:00
bashonly 9d7fde89a4
[extractor/zee5] Fix extraction of new content (#7280) 
Authored by: bashonly
 2023-06-11 17:15:05 +00:00
bashonly 1a2eb5bda5
[extractor/odnoklassniki] Fix formats extraction (#7217) 
Closes #2959, Closes #4462, Closes #7201
Authored by: bashonly
 2023-06-11 17:06:34 +00:00
DataGhost f8ae441501
[extractor/Dumpert] Fix m3u8 and support new URL pattern (#6091) 
Authored by: DataGhost, pukkandan
Closes #5032
 2023-06-11 20:47:26 +05:30
bashonly b4a252fba8
[jsinterp] Fix division (#7279) 
* Fixes nsig decryption for Youtube JS player `8c7583ff`

Authored by: bashonly
 2023-06-10 22:49:12 +00:00
bashonly 4f7b11cc1c
[extractor/voot] Fix extractor (#7227) 
Closes #6715
Authored by: bashonly
 2023-06-10 20:43:22 +00:00
bashonly d1795f4a6a
[extractor/twitter] Add login support (#7258) 
Closes #6951
Authored by: bashonly
 2023-06-08 18:47:13 +00:00
bashonly 44c0d66442
[extractor/lbry] Extract original quality formats (#7257) 
Closes #7251
Authored by: bashonly
 2023-06-08 18:36:09 +00:00
coletdjnz 8213ce28a4
[extractor/youtube] Extract channel_is_verified (#7213) 
Authored by: coletdjnz
 2023-06-08 19:15:39 +05:30
pukkandan 14a14335b2
[extractor/youtube] Misc cleanup 
Authored by: coletdjnz
 2023-06-08 19:14:57 +05:30
stanoarn c2b801fea5
[extractor/rozhlas] MujRozhlas: Add extractor (#7129) 
Authored by: stanoarn
 2023-06-07 20:18:06 +00:00
bashonly 59d9fe0831
[extractor/mgtv] Fix formats extraction (#7234) 
Closes #7008
Authored by: bashonly
 2023-06-05 15:52:45 +00:00
bashonly ee0ed0338d
[extractor/zdf] Fix formats extraction 
Closes #7238, Closes #7240
Authored by: bashonly
 2023-06-05 10:40:48 -05:00
bashonly c2a1bdb009
[extractor/tiktok] Extract 1080p adaptive formats (#7228) 
Closes #7109
Authored by: bashonly
 2023-06-04 14:28:40 +00:00
bashonly 7f8ddebbb5
[extractor/hotstar] Support /shows/ URLs (#7225) 
Closes #6463
Authored by: bashonly
 2023-06-04 14:19:16 +00:00
bashonly 7bc9251746
[extractor/shemaroome] Pass stream_key header to downloader (#7224) 
Closes #7133
Authored by: bashonly
 2023-06-04 14:07:13 +00:00
bashonly 4815d35c19
[extractor/sonyliv] Fix login with token (#7223) 
Authored by: bashonly
 2023-06-04 13:49:10 +00:00
bashonly 97d60ad8cd
[extractor/foxnews] Fix extractors (#7222) 
Closes #6050
Authored by: bashonly
 2023-06-04 13:37:59 +00:00
bashonly 5ee9a7d6e1
[extractor/sverigesradio] Support slug URLs (#7220) 
Closes #7145
Authored by: bashonly
 2023-06-04 12:15:09 +00:00
bashonly 971d901d12
[extractor/tencent] Fix fatal metadata extraction (#7219) 
Closes #7177
Authored by: bashonly
 2023-06-04 12:03:44 +00:00
bashonly 12037d8b0a
[extractor/substack] Fix extraction (#7218) 
Closes #7155
Authored by: bashonly
 2023-06-04 11:10:30 +00:00
Paul Wise c91ac833ea
[extractor/acast] Support embeds (#7212) 
Authored by: pabs3
 2023-06-04 13:34:47 +05:30
coletdjnz 2fb35f6004
[extractor/youtube] Support shorter relative time format (#7191) 
See: https://github.com/TeamNewPipe/NewPipeExtractor/issues/1067

Authored by: coletdjnz
 2023-06-03 06:33:51 +00:00
Jeroen Jacobs 1a7dcca378
[extractor/vrt] Overhaul extractors (#6244) 
* Fixes `VrtNU` extractor to work with the VRT MAX site change
* Adapts `VRT`, `Ketnet` and `DagelijkseKost` extractors to the new VRT API
* Removes `Canvas` and `CanvasEen` extractors; the sites and API no longer exist
* Moves all remaining VRT-related extractors into the `vrt` module

Closes #4908
Authored by: jeroenj, bergoid, bashonly

Co-authored-by: bergoid <bergoid@users.noreply.github.com>
Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>
 2023-06-02 18:29:00 +00:00
Mohamed Al Mehairbi 55ed4ff734
[extractor/DigitalConcertHall] Support films (#7202) 
Authored by: ItzMaxTV
Closes #7184
 2023-06-02 20:31:55 +05:30
bashonly 01231feb14
[extractor/twitch] Update _CLIENT_ID and add extractor-arg (#7200) 
Closes #7058, Closes #7183
Authored by: bashonly
 2023-06-02 13:39:24 +00:00
Daniel Rich f41b949a2e
[extractor/nhk] Fix API extraction (#7180) 
Closes #6992
Authored by: sjthespian, menschel

Co-authored-by: Patrick Menschel <menschel.p@posteo.de>
 2023-06-01 21:52:03 +00:00
coletdjnz c35448b7b1
[extractor/youtube] Extract more metadata for comments (#7179) 
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments

Closes https://github.com/yt-dlp/yt-dlp/issues/5411

Authored by: coletdjnz
 2023-06-01 08:43:32 +00:00
CeruleanSky 1c16d9df53
[extractor/twitter:spaces] Add release_timestamp (#7186) 
Authored by: CeruleanSky
 2023-06-01 12:05:41 +05:30
Mohamed Al Mehairbi ecfe47973f
[extractor/elevensports] Add extractor (#7172) 
Closes #6737
Authored by: ItzMaxTV
 2023-05-31 13:12:56 +00:00
coletdjnz 18f8fba7c8
[extractor/youtube] Fix continuation loop with no comments (#7148) 
Deep check the response for incomplete data.

Authored by: coletdjnz
 2023-05-31 07:08:28 +00:00
mrscrapy c2502cfed9
[extractor/recurbate] Add extractor (#6297) 
Authored by: mrscrapy
 2023-05-31 09:11:21 +05:30
bashonly 1fe5bf240e
[extractor/bravotv] Detect DRM (#7171) 
Authored by: bashonly
 2023-05-30 15:43:01 +00:00
Mohamed Al Mehairbi 26c517b29c
[extractor/crtvg] Add extractor (#7168) 
Closes #6609
Authored by: ItzMaxTV
 2023-05-30 13:40:56 +00:00
Elyse 6f10cdcf7e
[extractor/bilibili:SpaceVideo] Extract signature (#7149) 
Authored by: elyse0
Closes #6956, closes #7081
 2023-05-29 21:00:30 +05:30
HobbyistDev 03789976d3
[extractor/europarl] Rewrite extractor (#7114) 
Authored by: HobbyistDev
Closes #6396
 2023-05-29 20:50:07 +05:30
Mohamed Al Mehairbi dc3c44f349
[extractor/Mzaalo] Add extractor (#7163) 
Authored by: ItzMaxTV
 2023-05-29 20:49:13 +05:30
Ivan Skodje 937264419f
[extractor/tvplay] Remove outdated domains (#7106) 
Closes #3920
Authored by: ivanskodje
 2023-05-29 20:23:35 +05:30
Ivan Skodje 372a0f3b9d
Auto-select default format in -f- (#7101) 
Authored by: ivanskodje, pukkandan
Closes #6720
 2023-05-29 20:20:21 +05:30
garret 4cbfa570a1
[extractor/camfm] Add extractors (#7083) 
Authored by: garret1317
 2023-05-29 20:14:26 +05:30
HobbyistDev 45e87ea106
[extractor/eurosport] Improve _VALID_URL (#7076) 
Closes #7042
Authored by: HobbyistDev
 2023-05-29 20:01:22 +05:30
Florian Albrechtskirchinger dbce5afa6b
[extractor/twitch:vod] Support links from schedule tab (#7071) 
Authored by: falbrechtskirchinger
 2023-05-29 20:00:20 +05:30
Stefan Lobbenmeier f78eb41e1c
[extractor/ARDBetaMediathek] Add thumbnail (#6890) 
Closes #6889
Authored by: StefanLobbenmeier
 2023-05-29 19:58:14 +05:30
Matt Broadway b38d4c941d
[cookies] Update for chromium changes (#6897) 
Authored by: mbway
 2023-05-29 19:21:35 +05:30
hasezoey 489f51279d
[extractor/nekohacker] Add extractor (#7003) 
Authored by: hasezoey
 2023-05-29 10:52:01 +00:00
JChris246 2d306c03d6
[extractor/rottentomatoes] Fix extractor (#6844) 
Closes #6729
Authored by: JChris246
 2023-05-29 10:17:29 +00:00
bashonly f6e43d6fa9
[extractor/cbsnews] Overhaul extractors (#6681) 
Closes #6565
Authored by: bashonly
 2023-05-29 10:07:35 +00:00
bashonly fd5d93f704
Bugfix for b844a3f8b1 
[extractor/weverse] Avoid unnecessary duplicate login

Authored by: bashonly
 2023-05-29 04:42:03 -05:00
Lesmiscore f8f9250fe2
[extractor/niconico:live] Add extractor (#5764) 
Authored by: Lesmiscore
 2023-05-29 18:35:10 +09:00
Lesmiscore 3459d3c5af
[extractor/JStream] Add extractor (#6252) 
Authored by: Lesmiscore
 2023-05-29 18:33:37 +09:00
bashonly c25cac2f8e
[extractor/dacast] Add extractors (#6896) 
Closes #6163
Authored by: bashonly
 2023-05-29 06:40:44 +00:00
Nam Vu a58182b75a
[cookies] Support custom Safari cookies path (#6783) 
Authored by: NextFire
 2023-05-29 11:35:51 +05:30
jo-nike 4afb208cf0
[extractor/cbc] Ignore 426 from API (#6781) 
Closes #6716
Authored by: jo-nike
 2023-05-29 11:34:08 +05:30
ping 5c14b21367
[extractor/idolplus] Add extractor (#6732) 
Authored by:  ping
Closes #6246
 2023-05-29 11:31:42 +05:30
bepvte 02312c03cf
[extractor/twitch] Support mobile clips (#6699) 
Authored by: bepvte
 2023-05-29 11:24:36 +05:30
Stefan Borer 94627c5dde
[extractor/playsuisse] Support new url format (#6528) 
Authored by: sbor23
 2023-05-29 10:56:49 +05:30
Daniel Vogt c6d4b82a8b
[extractor/owncloud] Add extractor (#6533) 
Authored by: C0D3D3V
 2023-05-29 10:51:26 +05:30
Ha Tien Loi 17d7ca84ea
[extractor/zingmp3] Fix and improve extractors (#6367) 
Authored by: hatienl0i261299
 2023-05-29 10:32:16 +05:30
Mohit Tokas bfdf144c7e
[extractor/livestream] Support videos with account id (#6324) 
Authored by: theperfectpunk
Closes #2225
 2023-05-29 10:16:32 +05:30
nixxo c6d3f81a40
[extractor/rai] Rewrite extractors (#5940) 
Authored by: nixxo, danog
Closes #5672, closes #6341

Co-authored-by: Daniil Gentili <daniil@daniil.it>
 2023-05-29 09:50:03 +05:30
lauren n. liberda aed945e1b9
[extractor/wykop] Add extractors (#6140) 
Authored by: selfisekai
 2023-05-29 09:37:45 +05:30
JChris246 fc5a7f9b27
[extractor/daftsex] Update domain and embed player url (#5966) 
Closes #5881
Authored by: JChris246
 2023-05-29 09:01:26 +05:30
lauren n. liberda 738c90a463
[extractor/polskieradio] Improve extractors (#5948) 
Authored by: selfisekai
 2023-05-29 08:52:38 +05:30
coletdjnz 93e12ed76e
[extractor/youtube] Extract uploader metadata for feed/playlist items 
Fixes https://github.com/yt-dlp/yt-dlp/issues/7104

Authored by: coletdjnz
 2023-05-28 11:31:45 +12:00
Mohamed Al Mehairbi 6dc00acf0f
[extractor/weyyak] Add extractor (#7124) 
Closes #7118
Authored by: ItzMaxTV
 2023-05-27 18:32:39 +00:00
coletdjnz daafbf49b3
[core] Support decoding multiple content encodings (#7142) 
Authored by: coletdjnz
 2023-05-27 10:40:05 +00:00
coletdjnz 3f66b6fe50
[core] Workaround erroneous urllib Windows proxy parsing (#7092) 
Convert proxies extracted from windows registry to http for older Python versions.
See: https://github.com/python/cpython/issues/86793

Authored by: coletdjnz
 2023-05-27 07:17:27 +00:00
coletdjnz b87e01c123
[cookies] Move YoutubeDLCookieJar to cookies module (#7091) 
Authored by: coletdjnz
 2023-05-27 07:08:19 +00:00
coletdjnz 08916a49c7
[core] Improve HTTP redirect handling (#7094) 
Aligns HTTP redirect handling with what browsers commonly do and RFC standards. 

Fixes issues afac4caa7d missed.

Authored by: coletdjnz
 2023-05-27 07:06:13 +00:00
sqrtNOT 66468bbf49
[extractor/comedycentral] Add support for movies (#7108) 
Closes #1926
Authored by: sqrtNOT
 2023-05-26 13:03:19 +00:00
bashonly b844a3f8b1
[extractor/weverse] Add extractors (#6711) 
Closes #4786
Authored by: bashonly
 2023-05-26 12:57:10 +00:00
Audrey 5caf30dbc3
[extractor/youtube] Extract heatmap data (#7100) 
Closes #3888
Authored by: tntmod54321
 2023-05-26 17:54:39 +05:30
MMM 4ad58667c1
[extractor/bibeltv] Fix extraction, support live streams and series (#6505) 
Authored by: flashdagger
 2023-05-25 23:06:58 +02:00
Simon Sawicki edbe5b589d
Bugfixes for 4823ec9f46 
Hotfix for fragmented downloads

Authored by: bashonly
 2023-05-25 22:52:44 +02:00
Simon Sawicki 032de83ea9
[extractor/crunchyroll] Rework with support for movies, music and artists (#6237) 
This adds `CrunchyrollMusicIE` and `CrunchyrollArtistIE` extractors using the new, reworked base class and expands the `CrunchyrollBetaIE` with support for movies and movie listings and more complete metadata extraction

Authored by: Grub4K
 2023-05-24 20:45:15 +02:00
Simon Sawicki 8417f26b8a
[core] Implement --color flag (#6904) 
Authored by: Grub4K
 2023-05-24 20:35:07 +02:00
pukkandan 7aeda6cc9e
[jsinterp] Do not compile regex 2023-05-24 23:30:45 +05:30
pukkandan 4823ec9f46
Update to ytdl-commit-d1c6c5 
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6

Except:
    * 6ed34338285f722d0da312ce0af3a15a077a3e2a [jsinterp] Add short-cut evaluation for common expression
        * There was no performance improvement when tested with https://github.com/ytdl-org/youtube-dl/issues/30641
    * e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
        * We plan to implement this differently
 2023-05-24 23:30:43 +05:30
pukkandan 46f1370e9a
[devscripts/cli_to_api] Add script 2023-05-24 23:29:30 +05:30
kangalio 69a40e4a7f
[extractor/youtube:music:search_url] Extract title (#7102) 
Authored by: kangalio
Closes #7095
 2023-05-22 17:17:06 +05:30
coletdjnz 955c89584b
[core] Deprecate internal Youtubedl-no-compression header (#6876) 
Authored by: coletdjnz
 2023-05-20 22:55:09 +00:00
coletdjnz 69bec6730e
[cleanup, utils] Split into submodules (#7090) 
Closes https://github.com/yt-dlp/yt-dlp/pull/2173

Authored by: pukkandan, coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-05-20 21:56:23 +00:00
Simon Sawicki 665472a7de
[update] Implement --update-to repo 
Authored by: Grub4K, pukkandan
 2023-05-20 21:21:32 +02:00
Simon Sawicki d2e84d5eb0
[update] Better error handling 
Authored by: pukkandan
 2023-05-20 21:19:37 +02:00
coletdjnz 447afb9eaa
[extractor/youtube] Support podcasts and releases tabs 
Closes https://github.com/yt-dlp/yt-dlp/issues/6893

Authored by: coletdjnz
 2023-05-20 19:11:03 +12:00
pukkandan 6f2287cb18
[cleanup] Misc 
Closes #7030, closes #6967
 2023-05-20 04:23:41 +05:30
pukkandan 1d7656184c
[jsinterp] Handle NaN in bitwise operators 
Closes #6131
 2023-05-20 04:07:17 +05:30
pukkandan f7f7a877bf
[extractor/booyah] Remove extractor 
Site shut down. Closes #6425
 2023-05-20 04:05:22 +05:30
pukkandan c8bc203fbf
[docs] Misc improvements 
Closes #6814, closes #6940, closes #6733, closes #6923, closes #6566, closes #6726, closes #6728
 2023-05-20 02:38:24 +05:30
toomyzoom 21b9413cf7
[extractor/iwara] Implement login (#6721) 
Authored by: toomyzoom
 2023-05-11 18:48:35 +09:00
bashonly ef8fb7f029
[extractor/wrestleuniverse] Fix extraction, add login (#6982) 
Closes #6975
Authored by: bashonly, Grub4K

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
 2023-05-08 23:45:31 +00:00
ringus1 3b52a60688
[extractor/facebook] Fix metadata extraction (#6856) 
Closes #3432
Authored by: ringus1
 2023-05-08 23:19:42 +00:00
Lesmiscore c449c0655d
[extractor/abematv] Add fallback for title and description extraction and extract more metadata (#6994) 
Authored by: Lesmiscore
 2023-05-06 18:14:40 +09:00
lauren n. liberda 0c7ce146e4
[extractor/tvp] Use new API (#6989) 
Authored by: selfisekai
Closes #6987
 2023-05-06 05:39:49 +05:30
pukkandan ddae33754a
[extractor/youporn] Extract m3u8 formats 
Closes #6977
 2023-05-05 11:28:33 +05:30
Eveldee 45998b3e37
[utils] locked_file: Fix for virtiofs (#6840) 
Authored by: brandon-dacrib
Closes #6823
 2023-05-05 11:01:41 +05:30
bashonly 2f07c4c1da
[extractor/clipchamp] Add extractor (#6978) 
Closes #6973
Authored by: bashonly
 2023-05-03 20:46:37 +00:00
Nicholas Defranco b423b6a48e
[extractor/dlf] Add extractors (#6697) 
Closes #6430
Authored by: nick-cd
 2023-05-02 00:03:27 +00:00
bashonly 147e62fc58
[extractor/twitter] Default to GraphQL, handle auth errors (#6957) 
Closes #6763
Authored by: bashonly
 2023-05-01 23:55:28 +00:00
Simon Sawicki b079c26f0a
[utils] traverse_obj: More fixes (#6959) 
- Fix result when branching with `traverse_string`
- Fix `slice` path on `dict`s
- Fix tests and docstrings from 21b5ec86c2
- Add `is_iterable_like` helper function

Authored by: Grub4K
 2023-04-30 19:50:22 +02:00
bashonly 4d9280c9c8
[extractor/reddit] Add login support (#6950) 
Closes #6949
Authored by: bashonly
 2023-04-29 18:19:35 +00:00
pukkandan 17ba4343cf
Fix f005a35aa7 
Printing inside `finally` causes the order of logging to change
when there is an error, which is undesirable. So this is reverted.

The issue of `--print` being blocked by pre-processors was an
unintentional side-effect of changing the operation orders in
170605840e, and this is also partially
reverted.
 2023-04-29 03:06:42 +05:30
pukkandan f005a35aa7
Ensure pre-processor errors do not block --print 
Closes #6937
 2023-04-29 01:06:14 +05:30
makeworld 7a7b1376fb
[extractor/cbc] Fix live extractor, playlist _VALID_URL (#6625) 
Authored by: makew0rld
 2023-04-28 02:42:25 +00:00
pukkandan b5f61b69d4
Fix bug in 170605840e 
and related refactor
 2023-04-27 19:35:28 +05:30
pukkandan 7cf51f2191
[jsinterp] Handle negative numbers better 
Closes #6131
 2023-04-27 07:52:09 +05:30
pukkandan 170605840e
Populate filename and urls fields at all stages of --print 
Closes https://github.com/yt-dlp/yt-dlp/issues/6920
 2023-04-27 06:13:42 +05:30
garret 30647668a9
[extractor/globalplayer] Add extractors (#6903) 
Authored by: garret1317
 2023-04-26 23:42:07 +00:00