]>
jfr.im git - yt-dlp.git/log
bashonly [Sun, 27 Aug 2023 23:33:25 +0000 (18:33 -0500)]
[ie/StagePlus] Fix m3u8 extraction (#7929)
Closes #7928
Authored by: bashonly
bashonly [Fri, 25 Aug 2023 13:44:05 +0000 (08:44 -0500)]
[ie/Mzaalo] Improve `_VALID_URL`
Authored by: bashonly
Simon Sawicki [Sat, 26 Aug 2023 22:13:30 +0000 (00:13 +0200)]
[rh/urllib] Simplify gzip decoding (#7611)
Authored by: Grub4K
Simon Sawicki [Sat, 26 Aug 2023 20:29:56 +0000 (22:29 +0200)]
[docs] Update collaborators
Authored by: Grub4K
coletdjnz [Fri, 25 Aug 2023 07:10:44 +0000 (07:10 +0000)]
[tests] Add tests for socks proxies (#7908)
Authored by: coletdjnz
Davin Kevin [Sun, 20 Aug 2023 17:25:49 +0000 (19:25 +0200)]
[ie/wat.tv] Fix extraction (#7898)
Closes #7303
Authored by: davinkevin
trainman261 [Sun, 20 Aug 2023 16:35:57 +0000 (18:35 +0200)]
[ie/CBCPlayerPlaylist] Add extractor (#7870)
Authored by: trainman261
bashonly [Sun, 20 Aug 2023 16:10:15 +0000 (11:10 -0500)]
[ie/zee5] Update access token endpoint (#7914)
Closes #7911
Authored by: bashonly
garret [Mon, 14 Aug 2023 18:29:04 +0000 (19:29 +0100)]
[ie/tbsjp] Add episode, program, playlist extractors (#7765)
Authored by: garret1317
trainman261 [Sat, 12 Aug 2023 23:58:55 +0000 (01:58 +0200)]
[ie/CBCPlayer] Extract HLS formats and subtitles (#7484)
Authored by: trainman261
bashonly [Sat, 12 Aug 2023 21:30:23 +0000 (16:30 -0500)]
[cookies] Containers JSON should be opened as utf-8 (#7800)
Closes #7797
Authored by: bashonly
coletdjnz [Sat, 12 Aug 2023 04:26:08 +0000 (16:26 +1200)]
[ie/youtube] Fix consent cookie (#7774)
Fixes #7594
Authored by: coletdjnz
coletdjnz [Fri, 4 Aug 2023 22:17:48 +0000 (10:17 +1200)]
[networking] Add request handler preference framework (#7603)
Preference functions that take a request and a request handler instance can be registered to prioritize different request handlers per request.
Authored by: coletdjnz
Co-authored-by: pukkandan <redacted>
Franklin Lee [Tue, 1 Aug 2023 18:21:16 +0000 (11:21 -0700)]
[ie/PicartoVod] Fix extractor (#7727)
Closes #2926
Authored by: Frankgoji
ifan-t [Tue, 1 Aug 2023 18:01:59 +0000 (19:01 +0100)]
[ie/S4C] Add extractor (#7730)
Authored by: ifan-t
ringus1 [Tue, 1 Aug 2023 14:13:54 +0000 (16:13 +0200)]
[ie/facebook] Add dash manifest URL (#7743)
Fixes #7742
Authored by: ringus1
ischmidt20 [Tue, 1 Aug 2023 07:24:04 +0000 (03:24 -0400)]
[ie/fox] Support foxsports.com (#7724)
Authored by: ischmidt20
Steve [Mon, 31 Jul 2023 17:08:37 +0000 (10:08 -0700)]
[extractor/pbs] Add extractor `PBSKidsIE` (#7602)
Authored by: snixon
Fixes #2440
bashonly [Sat, 29 Jul 2023 23:37:06 +0000 (18:37 -0500)]
[ie/twitter] Add fallback, improve error handling (#7621)
Closes #7579, Closes #7625
Authored by: bashonly
pukkandan [Sat, 29 Jul 2023 22:54:38 +0000 (04:24 +0530)]
`FFmpegFixupM3u8PP` may need to run with ffmpeg
Bug in
62b5c94cadaa5f596dc1a7083db9db12efe357be
Closes #7725
coletdjnz [Sat, 29 Jul 2023 22:50:25 +0000 (10:50 +1200)]
[ie/youtube] Fix `player_params` arg being converted to lowercase
Fix bug in
ba06d77a316650ff057347d224b5afa8b203ad65
Authored by: coletdjnz
pukkandan [Sat, 29 Jul 2023 22:06:17 +0000 (03:36 +0530)]
[cleanup] Misc
pukkandan [Sat, 29 Jul 2023 21:51:35 +0000 (03:21 +0530)]
pukkandan [Sat, 29 Jul 2023 21:48:10 +0000 (03:18 +0530)]
[utils] HTTPHeaderDict: Handle byte values
pukkandan [Fri, 28 Jul 2023 08:18:17 +0000 (13:48 +0530)]
[test] Fix `test_load_certifi`
Closes #7688, #7675
bashonly [Sat, 29 Jul 2023 16:14:16 +0000 (11:14 -0500)]
[ie/tiktok] Fix audio-only format extraction (#7712)
Closes #6608
Authored by: bashonly
bashonly [Sat, 29 Jul 2023 16:01:43 +0000 (11:01 -0500)]
[ie/LBRY] Fix original format extraction (#7711)
Authored by: bashonly
bashonly [Sat, 29 Jul 2023 15:47:43 +0000 (10:47 -0500)]
[ie/hotstar] Support `/clips/` URLs (#7710)
Closes #7699
Authored by: bashonly
bashonly [Fri, 28 Jul 2023 22:21:45 +0000 (17:21 -0500)]
[ie/Reddit] Fix thumbnail extraction
Authored by: bashonly
coletdjnz [Sat, 29 Jul 2023 06:20:42 +0000 (18:20 +1200)]
[ie/youtube] Add `player_params` extractor arg (#7719)
Authored by: coletdjnz
coletdjnz [Fri, 28 Jul 2023 22:40:20 +0000 (10:40 +1200)]
[networking] Remove dot segments during URL normalization (#7662)
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.
Closes #3355, #6526
Authored by: coletdjnz
nnoboa [Fri, 28 Jul 2023 18:52:07 +0000 (14:52 -0400)]
[ie/Wimbledon] Add extractor (#7551)
Closes #7462
Authored by: nnoboa
Amirreza Aflakparast [Fri, 28 Jul 2023 18:51:16 +0000 (22:21 +0330)]
[ie/MotorTrendOnDemand] Update `_VALID_URL` (#7683)
Closes #7680
Authored by: AmirAflak
coletdjnz [Thu, 27 Jul 2023 14:56:02 +0000 (02:56 +1200)]
[networking] Ignore invalid proxies in env (#7704)
Authored by: coletdjnz
bashonly [Thu, 27 Jul 2023 14:53:22 +0000 (09:53 -0500)]
[ie/WrestleUniversePPV] Fix HLS AES key extraction
Fix bug in
ef8fb7f029b816dfc95600727d84400591a3b5c5
Closes #7708
Authored by: bashonly
coletdjnz [Mon, 24 Jul 2023 19:18:52 +0000 (07:18 +1200)]
[test] Fix `httplib_validation_errors` test for old Python versions (#7677)
Fixes https://github.com/yt-dlp/yt-dlp/issues/7674
Authored by: coletdjnz
bashonly [Mon, 24 Jul 2023 00:09:52 +0000 (19:09 -0500)]
[ie] Extract subtitles from SMIL manifests (#7667)
Authored by: bashonly, pukkandan
bashonly [Sun, 23 Jul 2023 23:29:45 +0000 (18:29 -0500)]
[ie/triller] Fix unlisted video extraction (#7670)
Authored by: bashonly
coletdjnz [Sun, 23 Jul 2023 05:17:15 +0000 (17:17 +1200)]
[networking] Add strict Request extension checking (#7604)
Authored by: coletdjnz
Co-authored-by: pukkandan <redacted>
bashonly [Sat, 22 Jul 2023 13:10:25 +0000 (08:10 -0500)]
[ie/PatreonCampaign] Fix extraction (#7664)
Authored by: bashonly
pukkandan [Sat, 22 Jul 2023 12:26:53 +0000 (17:56 +0530)]
[compat] Ensure submodules are imported correctly
Closes #7663
pukkandan [Sat, 22 Jul 2023 04:47:36 +0000 (10:17 +0530)]
pukkandan [Sat, 22 Jul 2023 04:13:51 +0000 (09:43 +0530)]
[ie/unsupported] List more sites with DRM
Closes #7323, #3072, #5740, #5767, #6125
pukkandan [Sat, 22 Jul 2023 03:38:12 +0000 (09:08 +0530)]
[cleanup] Misc fixes
Closes #7528
pukkandan [Sat, 22 Jul 2023 03:26:45 +0000 (08:56 +0530)]
[compat] Add `types.NoneType`
pukkandan [Sat, 22 Jul 2023 02:58:38 +0000 (08:28 +0530)]
[extractor] Fix `--load-pages`
pukkandan [Sat, 22 Jul 2023 02:24:25 +0000 (07:54 +0530)]
[ie/generic] Fix generic title for embeds
Closes #7067
pukkandan [Sat, 22 Jul 2023 02:22:55 +0000 (07:52 +0530)]
[outtmpl] Fix replacement for `playlist_index`
pukkandan [Wed, 19 Jul 2023 01:41:52 +0000 (07:11 +0530)]
[ie/abematv] Temporary fix for protocol handler
Closes #7622
bashonly [Sat, 22 Jul 2023 02:32:49 +0000 (21:32 -0500)]
[fd/external] Fix ffmpeg input from stdin (#7655)
Bugfix for
1ceb657bdd254ad961489e5060f2ccc7d556b729
Authored by: bashonly
Simon Sawicki [Thu, 20 Jul 2023 20:09:52 +0000 (22:09 +0200)]
[ie/crunchyroll] Remove initial state extraction (#7632)
Authored by: Grub4K
bashonly [Thu, 20 Jul 2023 14:15:21 +0000 (09:15 -0500)]
[ie/MuseAI] Add extractor (#7614)
Closes #7543
Authored by: bashonly
bashonly [Thu, 20 Jul 2023 14:02:50 +0000 (09:02 -0500)]
[ie/MagellanTV] Add extractor (#7616)
Closes #7529
Authored by: bashonly
bashonly [Thu, 20 Jul 2023 13:40:31 +0000 (08:40 -0500)]
[utils] Improve `parse_duration`
Authored by: bashonly
bashonly [Thu, 20 Jul 2023 13:31:17 +0000 (08:31 -0500)]
[networking] Fix `--legacy-server-connect` (#7645)
Bugfix for
227bf1a33be7b89cd7d44ad046844c4ccba104f4
Authored by: bashonly
bashonly [Thu, 20 Jul 2023 13:23:30 +0000 (08:23 -0500)]
[networking] Fix POST requests with zero-length payloads (#7648)
Bugfix for
227bf1a33be7b89cd7d44ad046844c4ccba104f4
Authored by: bashonly
bashonly [Sat, 15 Jul 2023 21:10:12 +0000 (16:10 -0500)]
[ie/twitter:spaces] Fix format protocol (#7550)
Closes #7536
Authored by: bashonly
Văn Anh [Sat, 15 Jul 2023 21:03:23 +0000 (04:03 +0700)]
[ie/facebook:reel] Fix extraction (#7564)
Closes #7469
Authored by: demon071, bashonly
zhong-yiyu [Sat, 15 Jul 2023 20:54:19 +0000 (21:54 +0100)]
[ie/pornhub] Update access cookies for UK (#7591)
Closes #7590
Authored by: zhong-yiyu
bashonly [Sat, 15 Jul 2023 20:18:25 +0000 (15:18 -0500)]
[fd/external] Fixes to cookie handling
- Fix bug in `axel` Cookie header arg
- Pass cookies to `curl` as strings
- Write session cookies for `aria2c` and `wget`
Closes #7539
Authored by: bashonly
bashonly [Sat, 15 Jul 2023 20:22:10 +0000 (15:22 -0500)]
[core] Fix HTTP headers and cookie handling
- Remove `Cookie` header from `http_headers` immediately after loading into cookiejar
- Restore compat for `--load-info-json` cookies
- Add more tests
- Fix improper passing of Cookie header by `MailRu` extractor
Closes #7558
Authored by: bashonly, pukkandan
Aaruni Kaushik [Sat, 15 Jul 2023 19:15:08 +0000 (21:15 +0200)]
[cleanup] Add color to `download-archive` message (#5138)
Authored by: aaruni96, Grub4K, pukkandan
Closes #4913
pukkandan [Sat, 15 Jul 2023 11:09:45 +0000 (16:39 +0530)]
[build] Make sure deprecated modules are added
coletdjnz [Sun, 9 Jul 2023 07:53:02 +0000 (13:23 +0530)]
[compat, networking] Deprecate old functions (#2861)
Authored by: coletdjnz, pukkandan
coletdjnz [Sat, 15 Jul 2023 10:25:23 +0000 (15:55 +0530)]
[networking] Rewrite architecture (#2861)
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.
User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
- Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`
Authored by: coletdjnz
pukkandan [Sat, 15 Jul 2023 09:00:08 +0000 (14:30 +0530)]
[networking] Add module (#2861)
No actual changes - code is only moved around
pukkandan [Sat, 15 Jul 2023 06:11:08 +0000 (11:41 +0530)]
[utils] Add temporary shim for logging
Related: #5680, #7517
coletdjnz [Sat, 15 Jul 2023 03:20:24 +0000 (15:20 +1200)]
[ie/youtube:tab] Detect looping feeds (#6621)
Closes https://github.com/yt-dlp/yt-dlp/issues/5555
Note: the first page may still be repeated, however this is better than nothing.
Authored by: coletdjnz
Finn R. Gärtner [Fri, 14 Jul 2023 18:09:02 +0000 (20:09 +0200)]
[ie/piapro] Support `/content` URL (#7592)
Authored by: FinnRG
Neurognostic [Thu, 13 Jul 2023 20:39:21 +0000 (16:39 -0400)]
[pp/EmbedThumbnail] Support `m4v` (#7583)
Authored by: Neurognostic
Aleri Kaisattera [Thu, 13 Jul 2023 14:17:05 +0000 (20:17 +0600)]
[ie/streamanity] Remove (#7571)
Service is dead
Authored by: alerikaisattera
Mahmoud Abdel-Fattah [Tue, 11 Jul 2023 01:00:38 +0000 (05:00 +0400)]
[utils] `clean_podcast_url`: Handle more trackers (#7556)
Authored by: mabdelfattah, bashonly
Closes #7544
Zprokkel [Mon, 10 Jul 2023 13:15:47 +0000 (15:15 +0200)]
[ie/vrt] Update token signing key (#7519)
Authored by: Zprokkel
GD-Slime [Sat, 8 Jul 2023 22:26:03 +0000 (06:26 +0800)]
[ie/BiliBiliBangumi] Fix extractors (#7337)
- Overhaul BiliBiliBangumi extractor for the site's new API
- Add BiliBiliBangumiSeason extractor
- Refactor BiliBiliBangumiMedia extractor
Closes #6701, Closes #7400
Authored by: GD-Slime
bashonly [Thu, 6 Jul 2023 19:39:51 +0000 (14:39 -0500)]
[extractor/twitter] Fix GraphQL and legacy API (#7516)
Authored by: bashonly
pukkandan [Wed, 5 Jul 2023 20:30:23 +0000 (02:00 +0530)]
github-actions [Thu, 6 Jul 2023 18:57:59 +0000 (18:57 +0000)]
Release 2023.07.06
Created by: pukkandan
:ci skip all :ci run dl
pukkandan [Thu, 6 Jul 2023 13:48:35 +0000 (19:18 +0530)]
[docs] Minor fixes
Closes #7515
Simon Sawicki [Thu, 6 Jul 2023 16:21:04 +0000 (21:51 +0530)]
[core] Change how `Cookie` headers are handled
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: Grub4K
coletdjnz [Tue, 6 Jun 2023 08:44:51 +0000 (20:44 +1200)]
[core] Prevent `Cookie` leaks on HTTP redirect
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: coletdjnz
bashonly [Wed, 5 Jul 2023 20:16:28 +0000 (15:16 -0500)]
[fd/external] Scope cookies
- ffmpeg: Calculate cookies from cookiejar and pass with `-cookies` arg instead of `-headers`
- aria2c, curl, wget: Write cookiejar to file and use external FD built-in cookiejar support
- httpie: Calculate cookies from cookiejar instead of `http_headers`
- axel: Calculate cookies from cookiejar and disable http redirection if cookies are passed
- May break redirects, but axel simply don't have proper cookie support
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: bashonly, coletdjnz
pukkandan [Thu, 6 Jul 2023 14:05:49 +0000 (19:35 +0530)]
[ie/vidlii] Handle relative URLs
Closes #7480
pukkandan [Fri, 23 Jun 2023 12:46:07 +0000 (18:16 +0530)]
[ie/youtube] Avoid false DRM detection (#7396)
Some master manifests contain a mix of DRM and non-DRM formats
pukkandan [Thu, 6 Jul 2023 13:09:50 +0000 (18:39 +0530)]
[core] Allow extractors to mark formats as potentially DRM (#7396)
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.
Makes the error message when using `--test` inconsistent,
but doesn't really matter.
pukkandan [Thu, 6 Jul 2023 12:47:42 +0000 (18:17 +0530)]
[formats] Fix best fallback for storyboards
Partial fix for #7478
pukkandan [Thu, 6 Jul 2023 14:39:42 +0000 (20:09 +0530)]
[cleanup] Misc
pukkandan [Thu, 6 Jul 2023 12:04:51 +0000 (17:34 +0530)]
[devscripts/make_changelog] Skip reverted commits
pukkandan [Thu, 6 Jul 2023 12:38:44 +0000 (18:08 +0530)]
[outtmpl] Pad `playlist_index` etc even when with internal formatting
Closes #7501
pukkandan [Tue, 4 Jul 2023 13:16:32 +0000 (18:46 +0530)]
[downloader/http] Avoid infinite loop when no data is received
Closes #7504
Jorge [Thu, 6 Jul 2023 14:51:46 +0000 (16:51 +0200)]
[misc] Add CodeQL workflow (#7497)
coletdjnz [Thu, 6 Jul 2023 13:32:41 +0000 (01:32 +1200)]
[extractor/youtube:stories] Remove (#7459)
YouTube killed them
https://web.archive.org/web/
20230630153050 /https://support.google.com/youtube/thread/
217640760
bashonly [Wed, 5 Jul 2023 16:27:36 +0000 (11:27 -0500)]
[extractor/twitter] Fix unauthenticated extraction (#7476)
Closes #7473
Authored by: bashonly
bashonly [Wed, 5 Jul 2023 03:05:52 +0000 (22:05 -0500)]
[extractor/twitter:spaces] Fix extraction (#7512)
Closes #7455
Authored by: bashonly
RfadnjdExt [Wed, 5 Jul 2023 02:17:13 +0000 (09:17 +0700)]
[extractor/googledrive] Fix source format extraction (#7395)
Closes #7344
Authored by: RfadnjdExt
coletdjnz [Mon, 3 Jul 2023 10:47:10 +0000 (10:47 +0000)]
[extractor/youtube] Ignore incomplete data for comment threads by default (#7475)
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.
Closes https://github.com/yt-dlp/yt-dlp/issues/7474
Authored by: coletdjnz
c-basalt [Sun, 2 Jul 2023 19:31:00 +0000 (15:31 -0400)]
[extractor/vk] VKPlay, VKPlayLive: Add extractors (#7358)
Closes #7107
Authored by: c-basalt
urectanc [Fri, 30 Jun 2023 18:27:07 +0000 (03:27 +0900)]
[extractor/stacommu] Add extractors (#7432)
Authored by: urectanc
coletdjnz [Thu, 29 Jun 2023 23:26:27 +0000 (23:26 +0000)]
[extractor/youtube:tab] Support shorts-only playlists (#7425)
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424
Authored by: coletdjnz
Co-authored-by: pukkandan <redacted>
bashonly [Tue, 27 Jun 2023 21:50:02 +0000 (16:50 -0500)]
[extractor/Douyin] Fix extraction from webpage
Closes #7431
Authored by: bashonly
Xiao Han [Tue, 27 Jun 2023 21:16:57 +0000 (16:16 -0500)]
[extractor/abc] Fix extraction (#7434)
Closes #6433
Authored by: meliber