mirrors/yt-dlp
1
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-12-04 20:36:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
22872 commits 3 branches 101 tags 120 MiB
Commit graph

496 commits

Author SHA1 Message Date
pukkandan e7b17fce14
[ie/youtube] Update android params 
Discovered by LuanRT - https://github.com/LuanRT/YouTube.js/pull/624

Closes #9554
 2024-04-01 01:31:53 +05:30
Aron Buzinkay 17d248a587
[ie/youtube:search] Fix params for uncensored results (#9456) 
Closes #9156
Authored by: alb, pukkandan
 2024-03-19 23:25:04 +00:00
bashonly 50c943e8a0
Merge branch 'yt-dlp:master' into pr/yt-live-from-start-range 2024-03-19 15:18:22 -05:00
sepro 22e4dfacb6
[ie/youtube] Fix tbr calculation (#9489) 
Authored by: pukkandan

Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2024-03-18 18:07:22 +01:00
x11x 8828f4576b
[ie/youtube:tab] Fix tags extraction (#9413) 
Closes #9412
Authored by: x11x
 2024-03-10 15:20:48 +00:00
bashonly 7aad06541e
[ie/youtube] Further bump client versions (#9395) 
Authored by: bashonly
 2024-03-09 15:51:20 +00:00
bashonly 413d367580
[ie/youtube] Bump Android and iOS client versions (#9317) 
Closes #9316
Authored by: bashonly
 2024-02-29 23:02:50 +00:00
bashonly 6fc6349ef0
Merge branch 'master' into yt-live-from-start-range 2024-02-29 04:58:30 -06:00
Simon Sawicki 5eedc208ec
[ie/youtube] Better error when all player responses are skipped (#9083) 
Authored by: Grub4K, pukkandan

Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2024-02-24 23:20:22 +00:00
Lev 104a7b5a46
[ie] Migrate commonly plural fields to lists (#8917) 
Authored by: llistochek, pukkandan
Related: #3944
 2024-02-20 12:49:24 +05:30
bashonly 5156a16cf9
Merge branch 'master' into yt-live-from-start-range 2024-01-19 17:05:19 -06:00
Simon Sawicki f9fb3ce86e
[cleanup] Misc (#8598) 
Authored by: bashonly, pukkandan, seproDev, Grub4K

Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
 2023-12-30 22:27:36 +01:00
Pandey Ganesha 6b5d93b0b0
[ie/youtube] Fix like_count extraction (#8763) 
Closes #8759
Authored by: Ganesh910
 2023-12-13 07:04:12 +00:00
pukkandan 044886c220
[ie/youtube] Return empty playlist when channel/tab has no videos 
Closes #8634
 2023-12-06 03:44:13 +05:30
OIRNOIR 6a9c7a2b52
[ie/youtube] Support cf.piped.video (#8514) 
Authored by: OIRNOIR
Closes #8457
 2023-11-29 18:18:58 +05:30
bashonly bb5a54e6db
[ie/youtube] Improve detection of faulty HLS formats (#8646) 
Closes #7747
Authored by: bashonly
 2023-11-26 02:21:29 +00:00
sepro 1732eccc0a
[core] Parse release_year from release_date (#8524) 
Closes #7263
Authored by: seproDev
 2023-11-26 02:12:05 +00:00
Simon Sawicki b012271d01
[cleanup] Misc (#8510) 
Authored by: bashonly, coletdjnz, dirkf, gamer191, seproDev, Grub4K
 2023-11-14 22:40:38 +01:00
bashonly fd8fcf8f4f
Revert 39abae2354 
The iOS client is not subject to integrity checks and is likely to be a more stable choice going forward

Authored by: bashonly
 2023-11-07 14:55:12 -06:00
bashonly ef79d20dc9
[ie/youtube] Check newly uploaded iOS HLS formats (#8336) 
Closes #7747
Authored by: bashonly
 2023-10-28 08:02:13 +00:00
bashonly 39abae2354
[ie/youtube] Deprioritize iOS client formats (#8337) 
Authored by: bashonly
 2023-10-28 08:01:31 +00:00
bashonly b634ba742d
[cleanup] Misc (#8338) 
Authored by: bashonly, gamer191
 2023-10-13 22:15:35 +00:00
Simon Sawicki feebf6d02f
[ie/youtube] Fix bug with --extractor-retries inf (#8328) 
Authored by: Grub4K
 2023-10-12 12:20:52 +02:00
Elyse 2741b5827d Merge remote-tracking branch 'origin' into yt-live-from-start-range 2023-10-08 00:24:29 -06:00
bashonly 03e85ea99d
[ie/youtube] Fix heatmap extraction (#8299) 
Closes #8189
Authored by: bashonly
 2023-10-06 20:00:15 -05:00
coletdjnz eb5bdbfa70
[ie/youtube] Raise a warning for Incomplete Data instead of an error (#8238) 
Closes https://github.com/yt-dlp/yt-dlp/issues/8206

Adds `raise_incomplete_data` extractor arg to revert this behaviour and raise an error.

Authored by: coletdjnz
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
 2023-10-03 06:42:30 +00:00
bashonly 5ca095cbcd
[cleanup] Misc (#8182) 
Closes #7796, Closes #8028
Authored by: barsnick, sqrtNOT, gamer191, coletdjnz, Grub4K, bashonly
 2023-09-23 20:00:31 +00:00
coletdjnz 378ae9f9fb
[ie/youtube] Fix consent cookie (#7774) 
Fixes #7594

Authored by: coletdjnz
 2023-08-12 04:26:08 +00:00
coletdjnz 546b2c28a1
[ie/youtube] Fix player_params arg being converted to lowercase 
Fix bug in ba06d77a31

Authored by: coletdjnz
 2023-07-30 10:50:25 +12:00
coletdjnz ba06d77a31
[ie/youtube] Add player_params extractor arg (#7719) 
Authored by: coletdjnz
 2023-07-29 06:20:42 +00:00
coletdjnz 3d2623a898
[compat, networking] Deprecate old functions (#2861) 
Authored by: coletdjnz, pukkandan
 2023-07-15 16:18:35 +05:30
coletdjnz 1ba6fe9db5
[ie/youtube:tab] Detect looping feeds (#6621) 
Closes https://github.com/yt-dlp/yt-dlp/issues/5555

Note: the first page may still be repeated, however this is better than nothing.

Authored by: coletdjnz
 2023-07-15 03:20:24 +00:00
pukkandan 94ed638a43
[ie/youtube] Avoid false DRM detection (#7396) 
Some master manifests contain a mix of DRM and non-DRM formats
 2023-07-06 21:40:07 +05:30
pukkandan 337734d4a8
[cleanup] Misc 2023-07-06 21:39:55 +05:30
coletdjnz 90db9a3c00
[extractor/youtube:stories] Remove (#7459) 
YouTube killed them

https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
 2023-07-06 19:02:41 +05:30
coletdjnz 4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default (#7475) 
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.

Closes https://github.com/yt-dlp/yt-dlp/issues/7474

Authored by: coletdjnz
 2023-07-03 10:47:10 +00:00
coletdjnz fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists (#7425) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
 2023-06-29 23:26:27 +00:00
pukkandan d949c10c45
[extractor/youtube] Process post_live over 2 hours 2023-06-26 07:25:52 +05:30
pukkandan 58786a10f2
[extractor/youtube] Add extractor-arg formats 
Closes #7417
 2023-06-25 20:14:37 +05:30
Elyse 99e6074c5d Merge remote-tracking branch 'origin' into yt-live-from-start-range 2023-06-24 14:30:12 -06:00
Simon 89bed01374
[extractor/youtube] Fix comments' is_favorited (#7390) 
Authored by: bbilly1
Closes #7389
 2023-06-22 23:38:42 +05:30
pukkandan cd810afe2a
[extractor/youtube] Improve nsig function name extraction 2023-06-22 13:27:18 +05:30
Berkan Teber 71dc18fa29
[extractor/youtube] Improve description parsing performance (#7315) 
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads

Authored by: pukkandan, berkanteber
 2023-06-22 12:57:54 +05:30
pukkandan 1e75d97db2
[extractor/youtube] Add ios to default clients used 
* IOS is affected neither by 403 or by nsig so helps mitigate them preemptively
* IOS also has higher bit-rate "premium" formats though they are not labeled as such
 2023-06-22 01:36:06 +05:30
pukkandan 81ca451480
[extractor/youtube] Workaround 403 for android formats 
Ref: https://github.com/TeamNewPipe/NewPipe/issues/9038#issuecomment-1289756816
 2023-06-22 00:15:22 +05:30
pukkandan ad54c9130e
[cleanup] Misc 
Closes #6288, Closes #7197, Closes #7265, Closes #7353, Closes #5773
Authored by: mikf, freezboltz, pukkandan
 2023-06-21 09:21:20 +05:30
pukkandan 97afb093d4
[extractor/youtube] Ignore wrong fps of some formats 2023-06-21 06:10:39 +05:30
pukkandan 51a07b0dca
[extractor/youtube] Prioritize premium formats 
Closes #7283
 2023-06-21 06:10:38 +05:30
pukkandan ff9b0e071f
[extractor/youtube] Determine audio language using automatic captions 2023-06-17 01:43:03 +05:30
coletdjnz 8213ce28a4
[extractor/youtube] Extract channel_is_verified (#7213) 
Authored by: coletdjnz
 2023-06-08 19:15:39 +05:30
pukkandan 14a14335b2
[extractor/youtube] Misc cleanup 
Authored by: coletdjnz
 2023-06-08 19:14:57 +05:30
Elyse 1f7974690e Merge remote-tracking branch 'origin' into yt-live-from-start-range 2023-06-03 14:39:32 -06:00
coletdjnz 2fb35f6004
[extractor/youtube] Support shorter relative time format (#7191) 
See: https://github.com/TeamNewPipe/NewPipeExtractor/issues/1067

Authored by: coletdjnz
 2023-06-03 06:33:51 +00:00
coletdjnz c35448b7b1
[extractor/youtube] Extract more metadata for comments (#7179) 
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments

Closes https://github.com/yt-dlp/yt-dlp/issues/5411

Authored by: coletdjnz
 2023-06-01 08:43:32 +00:00
coletdjnz 18f8fba7c8
[extractor/youtube] Fix continuation loop with no comments (#7148) 
Deep check the response for incomplete data.

Authored by: coletdjnz
 2023-05-31 07:08:28 +00:00
coletdjnz 93e12ed76e
[extractor/youtube] Extract uploader metadata for feed/playlist items 
Fixes https://github.com/yt-dlp/yt-dlp/issues/7104

Authored by: coletdjnz
 2023-05-28 11:31:45 +12:00
Audrey 5caf30dbc3
[extractor/youtube] Extract heatmap data (#7100) 
Closes #3888
Authored by: tntmod54321
 2023-05-26 17:54:39 +05:30
pukkandan 4823ec9f46
Update to ytdl-commit-d1c6c5 
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6

Except:
    * 6ed34338285f722d0da312ce0af3a15a077a3e2a [jsinterp] Add short-cut evaluation for common expression
        * There was no performance improvement when tested with https://github.com/ytdl-org/youtube-dl/issues/30641
    * e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
        * We plan to implement this differently
 2023-05-24 23:30:43 +05:30
kangalio 69a40e4a7f
[extractor/youtube:music:search_url] Extract title (#7102) 
Authored by: kangalio
Closes #7095
 2023-05-22 17:17:06 +05:30
coletdjnz 447afb9eaa
[extractor/youtube] Support podcasts and releases tabs 
Closes https://github.com/yt-dlp/yt-dlp/issues/6893

Authored by: coletdjnz
 2023-05-20 19:11:03 +12:00
Elyse 8ee942a9c8 Add warning about --download-sections without --live-from-start 2023-05-13 13:29:28 -06:00
Elyse 444e02ef3b Merge remote-tracking branch 'origin/master' into yt-live-from-start-range 2023-05-07 00:33:18 -06:00
Elyse 7f93eb7a28 Support for epoch timestamps 2023-05-06 23:05:38 -06:00
Elyse 128d30492b Always compute last_seq 2023-04-18 23:17:39 -06:00
coletdjnz 7666b93604
[extractor/youtube] Define strict uploader metadata mapping (#6384) 
New mapping:
```
channel -> channel name
channel_id -> UCID
channel_url -> UCID channel url

uploader -> channel name (same as channel field)
uploader_id -> @handle
uploader_url -> @handle channel url 
```

Authored by: coletdjnz
 2023-04-14 07:58:36 +00:00
pukkandan c6786ff3ba
[extractor/youtube] Revert default formats to https 2023-04-11 21:43:31 +05:30
coletdjnz 141a8dff98
[extractor/youtube] Fix comment loop detection for pinned comments (#6714) 
Pinned comments may repeat a second time - this is expected.

Fixes https://github.com/yt-dlp/yt-dlp/issues/6712

Authored by: coletdjnz
 2023-04-06 07:44:22 +00:00
Elyse 129555b19a Fix return values of _extract_sequence_from_mpd 2023-03-17 22:39:21 -06:00
Elyse 01f672fe27 Lock less agressively 
This gives a speed performance of about 30%
 2023-03-17 22:37:31 -06:00
Nicholas Defranco 071670cbea
[extractor/youtube] Fix parsing comment_count (#6523) 
Closes #5849
Authored by: nick-cd
 2023-03-15 04:51:14 +05:30
coletdjnz 607510b9f2
[extractor/youtube] Handle incomplete initial data from watch page (#6510) 
Authored by: coletdjnz
 2023-03-13 01:43:37 +00:00
pukkandan e389d172b6
Fix 2a23d92d9e 
Closes #6517
 2023-03-12 14:47:05 +05:30
Elyse fbae888c65 Add debug for selected section 2023-03-11 19:51:14 -06:00
Elyse 0ed9a73a73 Add fragment count 2023-03-11 19:51:14 -06:00
Elyse e6e2eb00f1 Support negative durations 2023-03-11 19:51:14 -06:00
pukkandan 9fc70f3f6d [extractor/youtube] Construct fragment list lazily 
Building fragment list for all formats take significant time for large videos
 2023-03-11 19:51:14 -06:00
pukkandan 5ef1a928a7 [extractor/youtube] Add extractor-arg include_duplicate_formats 2023-03-11 19:51:14 -06:00
Lesmiscore db62ffdafe [extractor/youtube] Add client name to format_note when -v (#6254) 
Authored by: Lesmiscore, pukkandan
 2023-03-11 19:51:14 -06:00
pukkandan 2d1655493f [extractor/youtube] Bypass throttling for -f17 
and related cleanup

Thanks @AudricV for the finding
 2023-03-11 19:51:13 -06:00
pukkandan 2a23d92d9e
[extractor/youtube] Construct fragment list lazily 
Building fragment list for all formats take significant time for large videos
 2023-03-11 22:46:47 +05:30
pukkandan 86cb922118
[extractor/youtube] Add extractor-arg include_duplicate_formats 2023-03-11 22:34:13 +05:30
Lesmiscore c795c39f27
[extractor/youtube] Add client name to format_note when -v (#6254) 
Authored by: Lesmiscore, pukkandan
 2023-03-11 22:33:23 +05:30
Elyse e42e25619f Create last_segment_url only if necessary 2023-03-09 18:24:39 -06:00
Elyse fba1c397b1 [youtube] Support --download-sections for YT Livestream from start 2023-03-09 17:32:19 -06:00
pukkandan c9abebb851
[extractor/youtube] Bypass throttling for -f17 
and related cleanup

Thanks @AudricV for the finding
 2023-03-09 22:13:03 +05:30
pukkandan 392389b7df
[cleanup] Misc 2023-03-05 03:34:55 +05:30
mushbite 22ccd5420b
[extractor/rutube] Extract chapters from description (#6345) 
Authored by: mushbite
 2023-03-04 19:03:17 +05:30
coletdjnz 7f51861b18
[extractor/youtube] Detect and break on looping comments (#6301) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/6290

Authored by: coletdjnz
 2023-03-01 07:56:53 +00:00
pukkandan 5b28cef72d
[cleanup] Misc 2023-02-28 23:51:06 +05:30
pukkandan 31e183557f
[extractor/youtube] Extract channel view_count when /about tab is passed 2023-02-28 23:51:03 +05:30
pukkandan f34804b2f9
[extractor/youtube] Fix 5038f6d713 
* [fragment] Fix `request_data`
* [youtube] Don't use POST for now. It may be easier to break in future

Authored by: bashonly, coletdjnz
 2023-02-28 23:34:43 +05:30
pukkandan 5038f6d713
[extractor/youtube] Construct dash formats with range query 
Closes #6369
 2023-02-28 23:14:37 +05:30
pukkandan a538772969
[cleanup] Misc 
Closes #5897
 2023-02-17 17:52:22 +05:30
bashonly c61cf091a5
[extractor/youtube] uploader_id includes @ with handle 
Authored by: bashonly
 2023-02-17 02:14:45 -06:00
bashonly 149eb0bbf3
[extractor/youtube] Fix uploader_id extraction 
Closes #6247
Authored by: bashonly
 2023-02-16 08:51:45 -06:00
Bruno Guerreiro 78a78fa74d
[extractor/youtube] Add hyperpipe instances (#6020) 
Authored by: Generator
 2023-02-12 14:03:45 +05:30
Roland Hieber 05799a48c7
[extractor/youtube] Update invidious and piped instances (#6030) 
Authored by: rohieb
 2023-02-12 13:22:07 +05:30
Simon Sawicki 6839ae1f6d
[utils] traverse_obj: Fix more bugs 
and cleanup uses of `default=[]`

Continued from b1bde57bef
 2023-02-10 19:36:55 +05:30
pukkandan b032ff0f03
[extractor/youtube] Handle consent.youtube 2023-02-03 23:53:42 +05:30
pukkandan dad2210c0c
[extractor/youtube] Support /live/ URL 2023-02-03 23:53:41 +05:30