]>
jfr.im git - yt-dlp.git/log
rigstot [Thu, 29 Jul 2021 04:03:01 +0000 (06:03 +0200)]
[generic] Support KVS player (#549)
* Replaces the extractor for thisvid
Fixes: https://github.com/ytdl-org/youtube-dl/issues/2077
Authored-by: rigstot
pukkandan [Thu, 29 Jul 2021 02:56:17 +0000 (08:26 +0530)]
Add format types `j`, `l`, `q` for outtmpl
Closes #345
pukkandan [Wed, 28 Jul 2021 23:49:26 +0000 (05:19 +0530)]
Expand and escape environment variables correctly in outtmpl
Fixes: https://www.reddit.com/r/youtubedl/comments/otfmq3/ytdlp_same_parameters_different_results
MinePlayersPE [Tue, 27 Jul 2021 09:40:44 +0000 (16:40 +0700)]
[YouTube] Age-gate bypass implementation (#575)
* Calling the API with `clientScreen=EMBED` allows access to most age-gated videos - discovered by @ccdffddfddfdsfedeee (https://github.com/yt-dlp/yt-dlp/issues/574#issuecomment-
887171136 )
* Adds clients: (web/android/ios)_(embedded/agegate), mweb_embedded
* Renamed mobile_web to mweb
Closes #574
Authored by pukkandan, MinePlayersPE
pukkandan [Sun, 25 Jul 2021 22:03:42 +0000 (03:33 +0530)]
[youtube] Fix format sorting when using alternate clients
coletdjnz [Sun, 25 Jul 2021 22:18:36 +0000 (10:18 +1200)]
[youtube] Add `mobile_web` client (#557)
Authored by: colethedj
pukkandan [Sun, 25 Jul 2021 21:55:53 +0000 (03:25 +0530)]
[youtube] Add `player_client=all`
pukkandan [Sun, 25 Jul 2021 21:52:39 +0000 (03:22 +0530)]
Remove `asr` appearing twice in `-F`
pukkandan [Sun, 25 Jul 2021 19:40:06 +0000 (01:10 +0530)]
[bilibili] Improve `_VALID_URL`
Ashish [Sun, 25 Jul 2021 17:13:43 +0000 (22:43 +0530)]
[HotStarSeriesIE] Fix regex (#569)
Authored by: Ashish0804
Ashish [Sun, 25 Jul 2021 17:11:45 +0000 (22:41 +0530)]
[UtreonIE] Add extractor (#562)
Authored by: Ashish0804
nixxo [Sat, 24 Jul 2021 14:36:55 +0000 (16:36 +0200)]
[mediaset] Fix extraction (#564)
Closes #365
Authored by: nixxo
pukkandan [Sat, 24 Jul 2021 14:32:12 +0000 (20:02 +0530)]
[version] update
:ci skip all
pukkandan [Sat, 24 Jul 2021 01:33:14 +0000 (07:03 +0530)]
Release 2021.07.24
pukkandan [Sat, 24 Jul 2021 00:53:02 +0000 (06:23 +0530)]
[youtube:tab] Extract video duration early
Based on: https://github.com/ytdl-org/youtube-dl/pull/29487 by glenn-slayden
pukkandan [Sat, 24 Jul 2021 00:46:46 +0000 (06:16 +0530)]
[youtube] Simplify `_get_text` early
xtkoba [Fri, 23 Jul 2021 15:02:48 +0000 (00:02 +0900)]
[test] Add Python 3.10 (#480)
Authored-by: pukkandan, xtkoba
pukkandan [Fri, 23 Jul 2021 14:48:15 +0000 (20:18 +0530)]
[test] Use `pytest` instead of `nosetests` (#482)
`nosetests` is no longer being maintained : https://github.com/nose-devs/nose/issues/1099
and will stop working in py 3.10 as can be seen in #480
pukkandan [Fri, 23 Jul 2021 14:20:50 +0000 (19:50 +0530)]
[cookies] Handle errors when importing `keyring`
Workaround for #551
Matt Broadway [Fri, 23 Jul 2021 14:26:19 +0000 (15:26 +0100)]
[cookies] Handle `sqlite` `ImportError` gracefully (#554)
Closes #544
Authored by: mbway
pukkandan [Fri, 23 Jul 2021 04:14:28 +0000 (09:44 +0530)]
[downloader] Pass same status object to all `progress_hooks`
pukkandan [Fri, 23 Jul 2021 04:07:15 +0000 (09:37 +0530)]
[youtube] Fix subtitles only being extracted from the first client
Closes #547
pukkandan [Fri, 23 Jul 2021 04:05:23 +0000 (09:35 +0530)]
Try all clients even if age-gated
Reverts: https://github.com/yt-dlp/yt-dlp/pull/536/commits/
892e31ce7c5f66418fee26a24eda30e5fe79d901
If some API calls have any issue, saving the state will cause unnecessary errors
pukkandan [Fri, 23 Jul 2021 03:55:38 +0000 (09:25 +0530)]
[youtube] Disable `get_video_info` age-gate workaround
This now seems to be completely dead
Closes: #553
coletdjnz [Thu, 22 Jul 2021 08:11:04 +0000 (20:11 +1200)]
[youtube] Fix age-gated videos for API clients when cookies are supplied (#545)
Fixes #543
Authored by: colethedj
pukkandan [Wed, 21 Jul 2021 17:28:43 +0000 (22:58 +0530)]
[downloader] Pass `info_dict` to `progress_hook`s
pukkandan [Wed, 21 Jul 2021 21:30:21 +0000 (03:00 +0530)]
[cookies] bugfix
Fixes: https://github.com/yt-dlp/yt-dlp/pull/488#discussion_r674352059
pukkandan [Wed, 21 Jul 2021 21:07:51 +0000 (02:37 +0530)]
[version] update
:ci skip all
pukkandan [Wed, 21 Jul 2021 18:02:21 +0000 (23:32 +0530)]
Release 2021.07.21
and fix some typos
Closes #538
pukkandan [Wed, 21 Jul 2021 17:57:23 +0000 (23:27 +0530)]
[youtube] Make `--extractor-retries` work for more errors
Closes #507
pukkandan [Wed, 21 Jul 2021 19:45:32 +0000 (01:15 +0530)]
Fix bug where `original_url` was not propagated when `_type`=`url`
coletdjnz [Wed, 21 Jul 2021 20:45:05 +0000 (08:45 +1200)]
[youtube] Add debug message for SAPISID cookie extraction (#540)
Authored by: colethedj
Matt Broadway [Wed, 21 Jul 2021 20:32:49 +0000 (21:32 +0100)]
Add option `--cookies-from-browser` to load cookies from a browser (#488)
* also adds `--no-cookies-from-browser`
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29201
Authored by: mbway
pukkandan [Wed, 21 Jul 2021 15:15:45 +0000 (20:45 +0530)]
[youtube] Improve extraction of livestream metadata
Modified from and closes #441
Authored by: pukkandan, krichbanana
pukkandan [Wed, 21 Jul 2021 15:14:18 +0000 (20:44 +0530)]
Add field `live_status`
pukkandan [Wed, 21 Jul 2021 13:41:40 +0000 (19:11 +0530)]
Philip Xu [Wed, 21 Jul 2021 15:19:27 +0000 (11:19 -0400)]
[douyin] Add extractor (#513)
Authored-by: pukkandan, pyx
Henrik Heimbuerger [Wed, 21 Jul 2021 12:42:43 +0000 (14:42 +0200)]
[nebula] Authentication via tokens from cookie jar (#537)
Closes #496
Co-authored-by: hheimbuerger, TpmKranz
pukkandan [Wed, 21 Jul 2021 12:36:34 +0000 (18:06 +0530)]
Add `only_once` param for `write_debug`
pukkandan [Wed, 21 Jul 2021 05:47:27 +0000 (11:17 +0530)]
[utils] Improve `traverse_obj`
pukkandan [Wed, 21 Jul 2021 03:52:34 +0000 (09:22 +0530)]
[youtube] Extract data from multiple clients (#536)
* `player_client` accepts multiple clients
* default `player_client` = `android,web`
* music clients can be specifically requested
* Add IOS `player_client`
* Hide live dash since they can't be downloaded
Closes #501
Authored-by: pukkandan, colethedj
pukkandan [Tue, 20 Jul 2021 20:05:35 +0000 (01:35 +0530)]
Add `only_once` param for `report_warning`
Related: https://github.com/yt-dlp/yt-dlp/pull/488#discussion_r667527297
pukkandan [Tue, 20 Jul 2021 19:30:46 +0000 (01:00 +0530)]
Errors in playlist extraction should obey `--ignore-errors`
Related: https://github.com/yt-dlp/yt-dlp/issues/535#issuecomment-
883277272 , https://github.com/yt-dlp/yt-dlp/issues/518#issuecomment-
881794754
coletdjnz [Tue, 20 Jul 2021 18:01:28 +0000 (06:01 +1200)]
[youtube] Fix controversial videos when requested via API (#533)
Closes: https://github.com/yt-dlp/yt-dlp/issues/511#issuecomment-883024350
Authored by: colethedj
pukkandan [Tue, 20 Jul 2021 17:51:04 +0000 (23:21 +0530)]
[youtube:tab] Fix channels tab
pukkandan [Tue, 20 Jul 2021 17:46:38 +0000 (23:16 +0530)]
[utils] Fix LazyList for Falsey values
pukkandan [Tue, 20 Jul 2021 01:51:16 +0000 (07:21 +0530)]
[youtube] Make `parse_time_text` and `_extract_chapters` non-fatal
Related: #532,
7c365c210939bcf3497f212a163ca1987f189421
pukkandan [Tue, 20 Jul 2021 00:02:41 +0000 (05:32 +0530)]
[youtube] Sanity check `chapters` (and refactor related code)
Closes #520
pukkandan [Mon, 19 Jul 2021 23:59:42 +0000 (05:29 +0530)]
Rename `NOTE` in `-F` to `MORE INFO`
since it's often confused to be the same as `format_note`
pukkandan [Mon, 19 Jul 2021 22:10:35 +0000 (03:40 +0530)]
[youtube] Extract even more thumbnails and reduce testing
* Also fix bug where `_test_url` was being ignored
Ref: https://stackoverflow.com/a/
20542029
Related: #340
pukkandan [Mon, 19 Jul 2021 20:51:55 +0000 (02:21 +0530)]
[compat] Remove unnecessary code
pukkandan [Thu, 15 Jul 2021 14:52:49 +0000 (20:22 +0530)]
[utils] Improve `traverse_obj`
* Allow skipping a level: `traverse_obj([{k:v1}, {k:v2}], (None, k))` => `[v1, v2]`
* Make keys variadic: `traverse_obj(obj, k1: str, k2: str)` => `traverse_obj(obj, (k1,), (k2,))`
* Fetch from multiple keys: `traverse_obj([{k1:[1], k2:[2], k3:[3]}], (0, (k1, k2), 0))` => `[1, 2]`
TODO: Add tests
pukkandan [Thu, 15 Jul 2021 17:19:59 +0000 (22:49 +0530)]
[youtube] Extract more thumbnails
* The thumbnail URLs are hard-coded and their actual existence is tested lazily
* Added option `--no-check-formats` to not test them
Closes #340, Related: #402, #337, https://github.com/ytdl-org/youtube-dl/issues/29049
pukkandan [Fri, 16 Jul 2021 21:19:49 +0000 (02:49 +0530)]
[crunchyroll:playlist] Force http
Closes #495
pukkandan [Thu, 15 Jul 2021 17:58:01 +0000 (23:28 +0530)]
[docs] fix default of multistreams
pukkandan [Mon, 19 Jul 2021 17:56:22 +0000 (23:26 +0530)]
Add option `--exec-before-download`
Closes #530
mzbaulhaque [Mon, 19 Jul 2021 18:16:21 +0000 (00:16 +0600)]
[pornflip] Add new extractor (#523)
Authored-by: mzbaulhaque
coletdjnz [Mon, 19 Jul 2021 04:55:07 +0000 (16:55 +1200)]
[youtube] misc cleanup and bug fixes (#505)
* Update some `_extract_response` calls to keep them consistent
* Cleanup continuation extraction related code using new API format
* Improve `_extract_account_syncid` to support multiple parameters
* Generalize `get_text` and related functions into one
* Update `INNERTUBE_CONTEXT_CLIENT_NAME` with integer values
Authored by: colethedj
coletdjnz [Sun, 18 Jul 2021 06:23:32 +0000 (18:23 +1200)]
[youtube] Fix session index extraction and headers for non-web player clients (#526)
Fixes #522
coletdjnz [Sat, 17 Jul 2021 06:20:05 +0000 (18:20 +1200)]
[youtube] Fix authentication when using multiple accounts
`SESSION_INDEX` in `ytcfg` is the index of the active account and should be sent as `X-Goog-AuthUser` header
Closes #518
Authored by @colethedj
The Hatsune Daishi [Fri, 16 Jul 2021 14:36:53 +0000 (23:36 +0900)]
[yahoo:gyao:player] Relax `_VALID_URL` (#503)
Authored by: nao20010128nao
Felix S [Fri, 16 Jul 2021 14:22:56 +0000 (16:22 +0200)]
[generic] Extract previously missed subtitles (#515)
* [generic] Extract subtitles in cases missed previously
* [common] Detect discarded subtitles in SMIL manifests
* [generic] Extract everything in the SMIL manifest
Authored by: fstirlitz
pukkandan [Thu, 15 Jul 2021 18:00:49 +0000 (23:30 +0530)]
Revert "Merge webm formats into mkv if thumbnails are to be embedded (#173)"
This reverts commit
4d971a16b831a45147b6ae7ce53b3e105d204da7 by @damianoamatruda
Closes #500
This was wrongly checking for `write_thumbnail`
coletdjnz [Thu, 15 Jul 2021 02:42:30 +0000 (14:42 +1200)]
[youtube:tab] Extract playlist availability (#504)
Authored by: colethedj
coletdjnz [Wed, 14 Jul 2021 23:24:42 +0000 (11:24 +1200)]
[youtube:comments] Improve comment vote count parsing (fixes #506) (#508)
Authored by: colethedj
Felix S [Tue, 13 Jul 2021 23:36:18 +0000 (01:36 +0200)]
[RTP] Fix extraction and add subtitles (#497)
Authored by: fstirlitz
felix [Tue, 13 Jul 2021 07:18:20 +0000 (09:18 +0200)]
[utils] Improve `js_to_json` comment regex
Capture the newline character as part of a single-line comment
From #497, Authored by: fstirlitz
felix [Tue, 13 Jul 2021 07:17:39 +0000 (09:17 +0200)]
[extractor] Allow extracting multiple groups in `_search_regex`
From #497, Authored by: fstirlitz
coletdjnz [Tue, 13 Jul 2021 22:28:51 +0000 (10:28 +1200)]
[youtube] Use android client as default and add age-gate bypass for it (#492)
Authored by: colethedj
coletdjnz [Mon, 12 Jul 2021 01:20:03 +0000 (13:20 +1200)]
[youtube:comments] Fix `is_favorited` (#491)
Authored by colethedj
pukkandan [Mon, 12 Jul 2021 00:37:23 +0000 (06:07 +0530)]
[vlive] Extract thumbnail directly in addition to the one from Naver
Closes #477
pukkandan [Sun, 11 Jul 2021 23:40:08 +0000 (05:10 +0530)]
[metadatafromfield] Do not detect numbers as field names
Related: https://github.com/yt-dlp/yt-dlp/issues/486#issuecomment-
877820394
pukkandan [Sun, 11 Jul 2021 23:35:32 +0000 (05:05 +0530)]
[webtt] Fix timestamps
Closes #474
coletdjnz [Sun, 11 Jul 2021 23:18:40 +0000 (11:18 +1200)]
[youtube:comments] Move comment extraction to new API (#466)
Closes #438, #481, #485
Authored by: colethedj
Kevin O'Connor [Sun, 11 Jul 2021 11:06:26 +0000 (07:06 -0400)]
[BravoTV] Improve metadata extraction (#483)
Authored by: kevinoconnor7
pukkandan [Sat, 10 Jul 2021 22:37:25 +0000 (04:07 +0530)]
[embedthumbnail] Fix `_get_thumbnail_resolution`
pukkandan [Sat, 10 Jul 2021 22:14:39 +0000 (03:44 +0530)]
Improve `traverse_obj`
pukkandan [Sat, 10 Jul 2021 18:56:35 +0000 (00:26 +0530)]
[FFmpegMetadata] Add language of each stream
and some refactoring
pukkandan [Sat, 10 Jul 2021 21:59:44 +0000 (03:29 +0530)]
[utils] Add `variadic`
zackmark29 [Fri, 9 Jul 2021 20:38:09 +0000 (04:38 +0800)]
[VIKI] Rewrite extractors (#475)
Closes #462
Also added extractor-arg `video_types` to `vikichannel`
Co-authored-by: zackmark29, pukkandan
pukkandan [Thu, 8 Jul 2021 16:11:08 +0000 (21:41 +0530)]
[youtube] Fix sorting of 3gp format
pukkandan [Thu, 8 Jul 2021 15:33:13 +0000 (21:03 +0530)]
Improve `extractor_args` parsing
pukkandan [Wed, 7 Jul 2021 15:35:58 +0000 (21:05 +0530)]
Fix selectors `all`, `mergeall` and add tests
Bug from:
981052c9c6febb33b6547140a67a49ac0f5f4578
pukkandan [Wed, 7 Jul 2021 00:13:58 +0000 (05:43 +0530)]
[version] update
:ci skip all
pukkandan [Wed, 7 Jul 2021 00:05:20 +0000 (05:35 +0530)]
Release 2021.07.07
pukkandan [Tue, 6 Jul 2021 23:47:11 +0000 (05:17 +0530)]
Update to ytdl-commit-
a803582
[peertube] only call description endpoint if necessary
https://github.com/ytdl-org/youtube-dl/commit/
a8035827177d6b59aca03bd717acb6a9bdd75ada
Tom-Oliver Heidel [Tue, 6 Jul 2021 22:51:13 +0000 (00:51 +0200)]
[soundcloud] Allow login using oauth token (#469)
Authored by: blackjack4494
zenerdi0de [Tue, 6 Jul 2021 22:32:56 +0000 (04:02 +0530)]
[fancode] Fix extraction, support live and allow login with refresh token (#471)
Authored-by: zenerdi0de
OhMyBahGosh [Tue, 6 Jul 2021 21:56:51 +0000 (17:56 -0400)]
[AdobePass] Add Spectrum MSO (#470)
From: https://github.com/ytdl-org/youtube-dl/pull/26792
Co-authored by: kevinoconnor7, ohmybahgosh
pukkandan [Tue, 6 Jul 2021 21:21:29 +0000 (02:51 +0530)]
[Funimation] Rewrite extractor (See desc) (#444)
* Support direct `/player/` URL
* Treat the different versions of an episode as different formats of a single video. So `experience_id` can no longer be used as the video `id` and the `episode_id` is used instead. This means that all existing archives will break
* Extractor options `language` and `version` to pre-select them
* Compat option `seperate-video-versions` to fall back to old behavior (including using the old video IDs)
Closes #428
pukkandan [Tue, 6 Jul 2021 20:57:53 +0000 (02:27 +0530)]
[extractor] Minor improvements (See desc)
1. Allow removal of login hint - extractors can set their own login hint as part of `msg`
2. Cleanup `_merge_subtitles` signature
pukkandan [Tue, 6 Jul 2021 20:54:58 +0000 (02:24 +0530)]
[extractor] Prevent unnecessary download of hls manifests
and refactor `hls_split_discontinuity` code
pukkandan [Tue, 6 Jul 2021 20:25:54 +0000 (01:55 +0530)]
[fragment] Handle errors in threads correctly
pukkandan [Sat, 3 Jul 2021 16:23:13 +0000 (21:53 +0530)]
[cleanup] Fix linter and some typos
Related: https://github.com/ytdl-org/youtube-dl/pull/29398
nyuszika7h [Sat, 3 Jul 2021 16:08:08 +0000 (18:08 +0200)]
[videa] Fix extraction (#463)
Authored by: nyuszika7h
pukkandan [Fri, 2 Jul 2021 19:45:01 +0000 (01:15 +0530)]
Fixes for `--list` options (See desc)
1. Fix `--list-formats-old`
2. Allow listing with `--quiet`
3. Allow various listings to work together
4. Allow `--print` to work with listing
MinePlayersPE [Fri, 2 Jul 2021 14:24:41 +0000 (21:24 +0700)]
[RCTIPlus] Add extractor (#443)
Authored by: MinePlayersPE
pukkandan [Sun, 27 Jun 2021 02:05:58 +0000 (07:35 +0530)]
Some minor fixes and refactoring (see desc)
* [utils] Fix issues with reversal
* check_formats should catch `DownloadError`, not `ExtractorError`
* Simplify format selectors with `LazyList` and `yield from`
pukkandan [Fri, 2 Jul 2021 02:14:11 +0000 (07:44 +0530)]
[facebook] Extract description and fix title
Partially fixes: #453
pukkandan [Sun, 27 Jun 2021 02:12:13 +0000 (07:42 +0530)]
[downloader/ffmpeg] Fix `--ppa` when using simultaneous download