coletdjnz
c35448b7b1
[extractor/youtube] Extract more metadata for comments ( #7179 )
...
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments
Closes https://github.com/yt-dlp/yt-dlp/issues/5411
Authored by: coletdjnz
2023-06-01 08:43:32 +00:00
coletdjnz
b87e01c123
[cookies] Move YoutubeDLCookieJar to cookies module ( #7091 )
...
Authored by: coletdjnz
2023-05-27 07:08:19 +00:00
Audrey
5caf30dbc3
[extractor/youtube] Extract heatmap data ( #7100 )
...
Closes #3888
Authored by: tntmod54321
2023-05-26 17:54:39 +05:30
pukkandan
84ffeb7d5e
[extractor] Do not warn for invalid chapter data in description
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/6811#issuecomment-1509876209
2023-04-16 08:55:43 +05:30
pukkandan
f68434cc74
[extractor] Extract more metadata from ISM
...
Fixes 81b6102d20 (r105892531)
2023-03-25 13:18:21 +05:30
pukkandan
baa922b5c7
[extractor] Do not exit early for unsuitable url_result
2023-03-25 13:18:21 +05:30
mushbite
22ccd5420b
[extractor/rutube] Extract chapters from description ( #6345 )
...
Authored by: mushbite
2023-03-04 19:03:17 +05:30
pukkandan
5b28cef72d
[cleanup] Misc
2023-02-28 23:51:06 +05:30
pukkandan
f34804b2f9
[extractor/youtube] Fix 5038f6d713
...
* [fragment] Fix `request_data`
* [youtube] Don't use POST for now. It may be easier to break in future
Authored by: bashonly, coletdjnz
2023-02-28 23:34:43 +05:30
pukkandan
43a3eaf963
[extractor] Fix DRM detection in m3u8
...
Fixes https://github.com/ytdl-org/youtube-dl/issues/31693#issuecomment-1445202857
2023-02-26 10:27:46 +05:30
pukkandan
45b2ee6f4f
Update to ytdl-commit-2dd6c6e
...
[YouTube] Avoid crash if uploader_id extraction fails
2dd6c6edd8
2023-02-17 17:52:23 +05:30
LowSuggestion912
b23167e754
[extractor/common] Fix _search_nuxt_data ( #6062 )
...
Authored by: LowSuggestion912
2023-02-12 12:55:24 +05:30
bashonly
7e68567e50
[downloader/hls] Allow extractors to provide AES key ( #6158 )
...
and related cleanup
Authored by: bashonly, Grub4K
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2023-02-08 11:09:32 +05:30
bashonly
5ab3534d44
[extractor/slideslive] Fix slides and chapters/duration ( #6024 )
...
* Fix slides/thumbnails extraction
* Extract duration to fix issues w/ `--embed-chapters`, `--split-chapters`
* Add `InfoExtractor._extract_mpd_vod_duration` method
* Expand applicability of `InfoExtractor._parse_m3u8_vod_duration` method
Authored by: bashonly
2023-01-14 19:52:03 +00:00
bashonly
cb73b8460c
[extractor/nbc] Fix NBC and NBCStations extractors ( #6033 )
...
Improve `InfoExtractor._parse_smil_formats` extension detection
Closes #6019
Authored by: bashonly
2023-01-14 16:40:42 +00:00
pukkandan
edfc7725b1
[cleanup] Misc
2023-01-07 02:48:34 +05:30
pukkandan
08e29b9f1f
[cleanup] Misc
...
Closes #5576 , closes #5887
2023-01-02 19:40:15 +05:30
Simon Sawicki
32a84bcf4e
Update to ytdl-commit-195f22f6
...
[generic] Improve KVS (etc) extraction
195f22f679Closes #3716
Authored by: Grub4k, pukkandan
2023-01-02 19:15:36 +05:30
Matthew
e756f45ba0
Improve handling for overriding extractors with plugins ( #5916 )
...
* Extractors replaced with plugin extractors now show in debug output
* Better testcase handling
* Added documentation
Authored by: coletdjnz, pukkandan
2023-01-02 04:55:11 +00:00
pukkandan
0b5546c723
[extractor] Let _extract_format functions obey --ignore-no-formats
2022-12-23 01:44:18 +05:30
pukkandan
71df9b7fd5
[cleanup] Misc
2022-12-03 19:52:31 +05:30
pukkandan
9bcfe33be7
[utils] Make ExtractorError mutable
2022-11-30 06:10:26 +05:30
pukkandan
9f14daf22b
[extractor] Deprecate _sort_formats
2022-11-17 11:40:17 +05:30
pukkandan
784320c98c
Implement universal format sorting
...
Closes #5566
2022-11-17 11:05:49 +05:30
pukkandan
d0d74b7197
[utils] Move format sorting code into utils
2022-11-17 11:04:38 +05:30
pukkandan
105bfd90f5
Add new field aspect_ratio
...
Closes #5402
2022-11-16 06:57:09 +05:30
pukkandan
6368e2e639
[cleanup] Misc
...
Closes #5541
2022-11-16 06:57:07 +05:30
pukkandan
171a31dbe8
[extractor] Add a way to distinguish IEs that returns only videos
2022-11-13 10:56:04 +05:30
pukkandan
f7fc8d39e9
[extractor] Fix fatal=False for _search_nuxt_data
...
Closes #5423
2022-11-11 07:29:29 +05:30
Matthew
0cf643b234
[extractor/youtube] Differentiate between no and disabled comments ( #5491 )
...
`comments` and `comment_count` will be set to None, as opposed to
an empty list and 0, respectively.
Fixes https://github.com/yt-dlp/yt-dlp/issues/5068
Authored by: coletdjnz, pukkandan
2022-11-10 03:33:03 +00:00
pukkandan
46d09f8707
[cleanup] Lint and misc cleanup
2022-11-07 02:32:36 +05:30
pukkandan
62b8dac490
[extractor] Improve _generic_title
2022-10-31 17:41:48 +05:30
m4tu4g
c13a301a94
[extractor/zeenews] Add extractor ( #5289 )
...
Closes #4967
Authored by: m4tu4g, pukkandan
2022-10-20 03:17:18 +05:30
pukkandan
d5d1df8afd
[cleanup Misc
...
Closes #5162
2022-10-18 23:52:44 +05:30
pukkandan
5225df50cf
[extractor/youtube:tab] Let approximate_date return timestamp
2022-10-13 15:30:15 +05:30
pukkandan
ade1fa70cb
[extractor/generic] Separate embed extraction into own function ( #5176 )
2022-10-09 16:09:36 +05:30
Simon Sawicki
1d55ebabc9
[extractor/common] Fix json_ld type checks ( #5145 )
...
Closes #5144 , #5143
Authored by: Grub4K
2022-10-09 08:47:58 +05:30
Matthew
867c66ff97
[extractor/youtube] Extract concurrent view count for livestreams ( #5152 )
...
Adds new field `concurrent_view_count`
Closes https://github.com/yt-dlp/yt-dlp/issues/4843
Authored by: coletdjnz
2022-10-07 07:00:40 +00:00
pukkandan
a057779d5e
[cleanup] Minor fixes
...
Closes #5129 , Closes #4982
2022-10-04 01:48:14 +05:30
coletdjnz
d3a3d7f0cc
[extractor/JWPlatform] Fix extractor ( #5112 )
...
Fix bitrate and filesize extraction and support embeds with unquoted urls.
Related: #5106
Authored by: coletdjnz
2022-10-03 19:37:48 +00:00
pukkandan
8b7fb8b60d
[extractor] Make search_json able to parse lists
...
Now `contains_pattern` can be set to `\[.+\]`
2022-10-03 16:56:19 +05:30
nixxo
81b6102d20
[downloader/ism] Support ec-3 codec ( #5004 )
...
Closes #296
Authored by: nixxo
2022-09-30 23:03:29 +05:30
pukkandan
0f60ba6e65
[extractor] Improve json+ld extraction
...
Related #5035
2022-09-27 02:36:57 +05:30
pukkandan
2fa669f759
[docs] Misc improvements
...
Closes #4987 , Closes #4906 , Closes #4919 , Closes #4977 , Closes #4979
2022-09-22 02:15:55 +05:30
pukkandan
8ca48a1a54
[extractor] Fix fatal=False in RetryManager
2022-09-22 02:14:31 +05:30
Simon Sawicki
8817a80d3a
[cookies] Parse cookies leniently ( #4780 )
...
Closes #4776 , #3778
Authored by: Grub4K
2022-09-16 22:32:00 +05:30
pukkandan
2314b4d89f
Allow plugin extractors to replace the built-in ones
...
This allows easier plugin chaining; e.g.
- https://gist.github.com/pukkandan/24f13ff1ed385c5a390c1d7bd130d8f7
- https://gist.github.com/pukkandan/fcf5ca1785c80f64e471f0ee14f990fb
2022-09-16 17:02:52 +05:30
pukkandan
0cb0fdbbfe
[extractor/common] Escape % in representation_id of m3u8
...
Closes #4877
2022-09-10 03:42:14 +05:30
pukkandan
17ffed1842
[docs] Improvements
...
* Move detailed installation instructions to https://github.com/yt-dlp/yt-dlp/wiki/Installation
* Link to wiki where applicable
* Fix some mistakes. Closes #4853 , Closes #4855 , Closes #4852
* Improve some error messages
2022-09-07 17:38:05 +05:30
pukkandan
d2c8aadf79
[cleanup] Misc
...
Closes #4710 , Closes #4754 , Closes #4723
Authored by: pukkandan, MrRawes, DavidH-2022
2022-09-01 16:49:03 +05:30
pukkandan
f2e9fa3ef7
[FormatSort] Fix aext for --prefer-free-formats
...
Closes #4735
2022-09-01 16:46:31 +05:30
Lesmiscore
bfbecd1174
[extractor/newspicks] Add extractor ( #4725 )
...
Authored by: Lesmiscore
2022-08-31 02:07:55 +09:00
pukkandan
da4db748fa
[utils] Add deprecation_warning
...
See https://github.com/yt-dlp/yt-dlp/pull/2173#issuecomment-1097021515
2022-08-30 21:03:07 +05:30
pukkandan
fe7866d0ed
Add option --use-extractors
...
Deprecates `--force-generic-extractor`
Closes #3234 , Closes #2044
Related: #4307 , #1791
2022-08-24 07:47:51 +05:30
Lesmiscore
62b58c0936
[docs] Consistent use of e.g. ( #4643 )
...
Authored by: Lesmiscore
2022-08-14 17:34:13 +05:30
pukkandan
7e798d725e
[extractor] Fix format sorting of channels
2022-08-11 07:23:46 +05:30
pukkandan
b8ed0f15d4
[extractor] Add field audio_channels
2022-08-08 01:35:36 +05:30
pukkandan
0647d9251f
Minor bugfixes
2022-08-02 03:52:23 +05:30
pukkandan
be5c1ae862
Standardize retry mechanism ( #1649 )
...
* [utils] Create `RetryManager`
* Migrate all retries to use the manager
* [extractor] Add wrapper methods for convenience
* Standardize console messages for retries
* Add `--retry-sleep` for extractors
2022-08-02 01:43:18 +05:30
pukkandan
bfd973ece3
[extractors] Use new framework for existing embeds ( #4307 )
...
`Brightcove` is difficult to migrate because it's subclasses may depend
on the signature of the current functions. So it is left as-is for now
Note: Tests have not been migrated
2022-08-02 01:08:16 +05:30
pukkandan
1e8fe57e5c
[extractor] Support multiple archive ids for one video ( #4307 )
...
Closes #4352
2022-08-02 01:08:16 +05:30
pukkandan
f2e8dbcc00
[extractor, test] Basic framework for embed tests ( #4307 )
...
and split download tests so they can be more easily run in CI
Authored by: coletdjnz
2022-08-02 01:08:16 +05:30
pukkandan
8f97a15d1c
[extractor] Framework for embed detection ( #4307 )
2022-08-02 01:08:16 +05:30
lazypete365
e325a21a1f
[extractor/youtube] Add live_status=post_live ( #4495 )
...
Related: https://github.com/yt-dlp/yt-dlp/issues/1564
Authored by: lazypete365
2022-08-01 01:42:04 +05:30
pukkandan
b79f9e302d
--compat-option no-live-chat should disable danmaku
...
Closes #4387
2022-07-19 15:29:28 +05:30
pukkandan
6929b41a21
Remove Python 3.6 support
...
Closes #3764
2022-07-18 06:31:14 +05:30
pukkandan
c6e07cf1e1
[cleanup] Misc
2022-07-18 05:14:55 +05:30
pukkandan
6edf28081f
[extractor] Passthrough errnote=False to parsing
2022-07-15 16:10:47 +05:30
Tim Weber
eb2333bce1
[extractor/StarTrek] Add extractor ( #4191 )
...
Authored by: scy
2022-07-13 23:59:44 +05:30
ftk
45e8a04e48
[extractor/youtube] More metadata for storyboards ( #4334 )
...
Authored by: ftk
2022-07-12 20:46:45 +05:30
pukkandan
47046464fa
[extractor] Fix empty BaseURL in MPD
...
Closes #4113
2022-06-29 06:43:26 +05:30
crazymoose77756
962ffcf89c
[cleanup] Fix some typos ( #4194 )
...
Authored by: crazymoose77756
2022-06-26 17:50:06 -07:00
pukkandan
c043c24625
[extractor] Fix _create_request when headers is None
...
Closes #4164
2022-06-25 19:41:22 +05:30
pukkandan
14f25df2b6
[compat] Remove deprecated functions from core code
2022-06-25 00:14:12 +05:30
pukkandan
54007a45f1
[cleanup] Consistent style for file heads
2022-06-25 00:08:58 +05:30
pukkandan
ac66811112
[compat] Remove more functions
...
Removing any more will require changes to a large number of extractors
2022-06-25 00:08:55 +05:30
pukkandan
9809740ba5
[extractor, cleanup] Reduce direct use of _downloader
2022-06-23 09:57:26 +05:30
pukkandan
0c36dc00d7
[extractor/npr] Implement e50c3500b4 differently
...
Closes #4141
2022-06-23 01:46:49 +05:30
pukkandan
3975b4d2e8
Allow extractors to specify section_start/end for clips
2022-06-22 02:44:28 +05:30
pukkandan
612f2be5d3
Bugfix for 7b2c3f47c6
2022-06-20 12:03:35 +05:30
pukkandan
7b2c3f47c6
[cleanup] Misc
2022-06-20 11:44:55 +05:30
pukkandan
8072ef2bbd
[extractor/BiliIntl] Fix metadata extraction
...
Closes #4116
2022-06-20 03:05:46 +05:30
coletdev
f0bc6e2019
[extractor] Add default parameter to _search_json ( #4057 )
...
Authored by: pukkandan, coletdjnz
2022-06-18 17:55:18 -07:00
pukkandan
a70635b8a1
[cleanup, utils] Don't use kwargs for format_field
2022-06-18 08:13:22 +05:30
christoph-heinrich
e121e3cee7
[cleanup] Minor fixes ( #4096 )
...
Authored by: christoph-heinrich
2022-06-17 18:57:22 -07:00
Evan Spensley
145c5a83a8
[extractor/GoogleDrive] Add folder extractor ( #4009 )
...
Closes #3388
Authored by: evansp, pukkandan
2022-06-14 06:33:29 -07:00
pukkandan
f3c0c77304
[extractor] Handle json_ld with multiple @types
...
Closes : #4022
2022-06-13 19:12:34 +05:30
pukkandan
56ba69e4c9
[cleanup] Misc fixes
...
Closes #4027
2022-06-11 05:00:12 +05:30
Aurélien Grosdidier
d05460e5fe
[extractor/FranceCulture] Fix extractor ( #3874 )
...
Closes #3742
Authored by: aurelg, pukkandan
2022-06-10 16:22:34 -07:00
pukkandan
b7c47b7438
[extractor] Add _search_json
...
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
2022-06-06 19:46:45 +05:30
Lesmiscore
0bea4fd807
[extractor/0000studio] Add extractors ( #3959 )
...
Authored by: Lesmiscore
2022-06-05 14:37:05 +09:00
pukkandan
1890fc6389
[cleanup] Misc fixes
...
Cherry-picks from: #3498 , #3947
Related: #3949 , https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
2022-06-03 21:45:35 +05:30
pukkandan
c4910024f3
[extractor] Fix bug in 617f658b7e
...
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only
Closes #3954
2022-06-03 17:25:20 +05:30
siddharth ravikumar
e50c3500b4
[extractor/npr] Use stream url from json-ld ( #3455 )
...
Closes #1934
Authored by: r5d
2022-06-02 17:51:11 -07:00
pukkandan
09d02ea429
[extractor] Fix bug in f95b9dee45
...
Closes #3951
2022-06-03 06:16:01 +05:30
pukkandan
f95b9dee45
[extractor] Add dev option --load-pages
2022-06-01 02:03:22 +05:30
pukkandan
617f658b7e
[extractor, cleanup] Refactor _download_... methods
2022-06-01 01:57:16 +05:30
Lesmiscore
222a230871
[extractor/common] Recognize src attribute from HTML5 media elements ( #3899 )
...
Authored by: Lesmiscore
2022-05-29 22:48:04 +09:00
coletdjnz
ee27297f82
[extractor/youtube] Fix initial player response extraction
...
Authored by: pukkandan, coletdjnz
2022-05-29 19:54:22 +12:00
pukkandan
8a82af3511
[cleanup] Misc fixes and cleanup
...
Closes #3780 , Closes #3853 , Closes #3850
2022-05-27 04:43:43 +05:30
