Changelog.md

   1 # Changelog
   2
   3 <!--
   4 # Instuctions for creating release
   5
   6 * Run `make doc`
   7 * Update Changelog.md and CONTRIBUTORS
   8 * Change "Merged with ytdl" version in Readme.md if needed
   9 * Commit to master as `Release <version>`
  10 * Push to origin/release - build task will now run
  11 * Update version.py using devscripts\update-version.py
  12 * Run `make issuetemplates`
  13 * Commit to master as `[version] update :ci skip all`
  14 * Push to origin/master
  15 * Update changelog in /releases
  16
  17 -->
  18
  19
  20 ### 2021.03.01
  21 * Allow specifying path in `--external-downloader`
  22 * Add option `--sleep-requests` to sleep b/w requests
  23 * Add option `--extractor-retries` to retry on known extractor errors
  24 * Extract comments only when needed
  25 * `--get-comments` doesn't imply `--write-info-json` if `-J`, `-j` or `--print-json` are used
  26 * Fix `get_executable_path` by [shirt](https://github.com/shirt-dev)
  27 * [youtube] Retry on more known errors than just HTTP-5xx
  28 * [youtube] Fix inconsistent `webpage_url`
  29 * [tennistv] Fix format sorting
  30 * [bilibiliaudio] Recognize the file as audio-only
  31 * [hrfensehen] Fix wrong import
  32 * [viki] Fix viki play pass authentication by [RobinD42](https://github.com/RobinD42)
  33 * [readthedocs] Improvements by [shirt](https://github.com/shirt-dev)
  34 * [hls] Fix bug with m3u8 format extraction
  35 * [hls] Enable `--hls-use-mpegts` by default when downloading live-streams
  36 * [embedthumbnail] Fix bug with deleting original thumbnail
  37 * [build] Fix completion paths, zsh pip completion install by [hseg](https://github.com/hseg)
  38 * [ci] Disable download tests unless specifically invoked
  39 * Cleanup some code and fix typos
  40
  41
  42 ### 2021.02.24
  43 * Moved project to an organization [yt-dlp](https://github.com/yt-dlp)
  44 * **Completely changed project name to yt-dlp** by [Pccode66](https://github.com/Pccode66) and [pukkandan](https://github.com/pukkandan)
  45     * Also, `youtube-dlc` config files are no longer loaded
  46 * **Merge youtube-dl:** Upto [commit/4460329](https://github.com/ytdl-org/youtube-dl/commit/44603290e5002153f3ebad6230cc73aef42cc2cd) (except tmz, gedi)
  47 * [Readthedocs](https://yt-dlp.readthedocs.io) support by [shirt](https://github.com/shirt-dev)
  48 * [youtube] Show if video was a live stream in info (`was_live`)
  49 * [Zee5] Add new extractor by [Ashish](https://github.com/Ashish) and [pukkandan](https://github.com/pukkandan)
  50 * [jwplatform] Add support for `hyland.com`
  51 * [tennistv] Fix extractor
  52 * [hls] Support media initialization by [shirt](https://github.com/shirt-dev)
  53 * [hls] Added options `--hls-split-discontinuity` to better support media discontinuity by [shirt](https://github.com/shirt-dev)
  54 * [ffmpeg] Allow passing custom arguments before -i using `--ppa "ffmpeg_i1:ARGS"` syntax
  55 * Fix `--windows-filenames` removing `/` from UNIX paths
  56 * [hls] Show warning if pycryptodome is not found
  57 * [documentation] Improvements
  58     * Fix documentation of `Extractor Options`
  59     * Document `all` in format selection
  60     * Document `playable_in_embed` in output templates
  61
  62
  63 ### 2021.02.19
  64 * **Merge youtube-dl:** Upto [commit/cf2dbec](https://github.com/ytdl-org/youtube-dl/commit/cf2dbec6301177a1fddf72862de05fa912d9869d) (except kakao)
  65 * [viki] Fix extractor
  66 * [niconico] Extract `channel` and `channel_id` by [kurumigi](https://github.com/kurumigi)
  67 * [youtube] Multiple page support for hashtag URLs
  68 * [youtube] Add more invidious instances
  69 * [youtube] Fix comment extraction when comment text is empty
  70 * Option `--windows-filenames` to force use of windows compatible filenames
  71 * [ExtractAudio] Bugfix
  72 * Don't raise `parser.error` when exiting for update
  73 * [MoveFiles] Fix for when merger can't run
  74 * Changed `--trim-file-name` to `--trim-filenames` to be similar to related options
  75 * Format Sort improvements:
  76     * Prefer `vp9.2` more than other `vp9` codecs
  77     * Remove forced priority of `quality`
  78     * Remove unnecessary `field_preference` and misuse of `preference` from extractors
  79 * Build improvements:
  80     * Fix hash output by [shirt](https://github.com/shirt-dev)
  81     * Lock python package versions for x86 and use `wheels` by [shirt](https://github.com/shirt-dev)
  82     * Exclude `vcruntime140.dll` from UPX by [jbruchon](https://github.com/jbruchon)
  83     * Set version number based on UTC time, not local time
  84     * Publish on PyPi only if token is set
  85 * [documentation] Better document `--prefer-free-formats` and add `--no-prefer-free-format`
  86
  87
  88 ### 2021.02.15
  89 * **Merge youtube-dl:** Upto [2021.02.10](https://github.com/ytdl-org/youtube-dl/releases/tag/2021.02.10) (except archive.org)
  90 * [niconico] Improved extraction and support encrypted/SMILE movies by [kurumigi](https://github.com/kurumigi), [tsukumi](https://github.com/tsukumi), [bbepis](https://github.com/bbepis), [pukkandan](https://github.com/pukkandan)
  91 * Fix HLS AES-128 with multiple keys in external downloaders by [shirt](https://github.com/shirt-dev)
  92 * [youtube_live_chat] Fix by using POST API by [siikamiika](https://github.com/siikamiika)
  93 * [rumble] Add support for video page
  94 * Option `--allow-unplayable-formats` to allow downloading unplayable video formats
  95 * [ExtractAudio] Don't re-encode when file is already in a common audio format
  96 * [youtube] Fix search continuations
  97 * [youtube] Fix for new accounts
  98 * Improve build/updater: by [pukkandan](https://github.com/pukkandan) and [shirt](https://github.com/shirt-dev)
  99     * Fix SHA256 calculation in build and implement hash checking for updater
 100     * Exit immediately in windows once the update process starts
 101     * Fix updater for `x86.exe`
 102     * Updater looks for both `yt-dlp` and `youtube-dlc` in releases for future-proofing
 103     * Change optional dependency to `pycryptodome`
 104 * Fix issue with unicode filenames in aria2c by [shirt](https://github.com/shirt-dev)
 105 * Fix `allow_playlist_files` not being correctly passed through
 106 * Fix for empty HTTP head requests by [shirt](https://github.com/shirt-dev)
 107 * Fix `get_executable_path` in UNIX
 108 * [sponskrub] Print ffmpeg output and errors to terminal
 109 * `__real_download` should be false when ffmpeg unavailable and no download
 110 * Show `exe`/`zip`/`source` and 32/64bit in verbose message
 111
 112
 113 ### 2021.02.09
 114 * **aria2c support for DASH/HLS**: by [shirt](https://github.com/shirt-dev)
 115 * **Implement Updater** (`-U`) by [shirt](https://github.com/shirt-dev)
 116 * [youtube] Fix comment extraction
 117 * [youtube_live_chat] Improve extraction
 118 * [youtube] Fix for channel URLs sometimes not downloading all pages
 119 * [aria2c] Changed default arguments to `--console-log-level=warn --summary-interval=0 --file-allocation=none -x16 -j16 -s16`
 120 * Add fallback for thumbnails
 121 * [embedthumbnail] Keep original thumbnail after conversion if write_thumbnail given
 122 * [embedsubtitle] Keep original subtitle after conversion if write_subtitles given
 123 * [pyinst.py] Move back to root dir
 124 * [youtube] Simplified renderer parsing and bugfixes
 125 * [movefiles] Fix compatibility with python2
 126 * [remuxvideo] Fix validation of conditional remux
 127 * [sponskrub] Don't raise error when the video does not exist
 128 * [documentation] Crypto is an optional dependency
 129
 130
 131 ### 2021.02.04
 132 * **Merge youtube-dl:** Upto [2021.02.04.1](https://github.com/ytdl-org/youtube-dl/releases/tag/2021.02.04.1)
 133 * **Date/time formatting in output template:**
 134     * You can use [`strftime`](https://docs.python.org/3/library/datetime.html#strftime-and-strptime-format-codes) to format date/time fields. Example: `%(upload_date>%Y-%m-%d)s`
 135 * **Multiple output templates:**
 136     * Separate output templates can be given for the different metadata files by using `-o TYPE:TEMPLATE`
 137     * The allowed types are: `subtitle|thumbnail|description|annotation|infojson|pl_description|pl_infojson`
 138 * [youtube] More metadata extraction for channel/playlist URLs (channel, uploader, thumbnail, tags)
 139 * New option `--no-write-playlist-metafiles` to prevent writing playlist metadata files
 140 * [audius] Fix extractor
 141 * [youtube_live_chat] Fix `parse_yt_initial_data` and add `fragment_retries`
 142 * [postprocessor] Raise errors correctly
 143 * [metadatafromtitle] Fix bug when extracting data from numeric fields
 144 * Fix issue with overwriting files
 145 * Fix "Default format spec" appearing in quiet mode
 146 * [FormatSort] Allow user to prefer av01 over vp9 (The default is still vp9)
 147 * [FormatSort] fix bug where `quality` had more priority than `hasvid`
 148 * [pyinst] Automatically detect python architecture and working directory
 149 * Strip out internal fields such as `_filename` from infojson
 150
 151
 152 ### 2021.01.29
 153 * **Features from [animelover1984/youtube-dl](https://github.com/animelover1984/youtube-dl)**: by [animelover1984](https://github.com/animelover1984) and [bbepis](https://github.com/bbepis)
 154     * Add `--get-comments`
 155     * [youtube] Extract comments
 156     * [billibilli] Added BiliBiliSearchIE, BilibiliChannelIE
 157     * [billibilli] Extract comments
 158     * [billibilli] Better video extraction
 159     * Write playlist data to infojson
 160     * [FFmpegMetadata] Embed infojson inside the video
 161     * [EmbedThumbnail] Try embedding in mp4 using ffprobe and `-disposition`
 162     * [EmbedThumbnail] Treat mka like mkv and mov like mp4
 163     * [EmbedThumbnail] Embed in ogg/opus
 164     * [VideoRemuxer] Conditionally remux video
 165     * [VideoRemuxer] Add `-movflags +faststart` when remuxing to mp4
 166     * [ffmpeg] Print entire stderr in verbose when there is error
 167     * [EmbedSubtitle] Warn when embedding ass in mp4
 168     * [anvato] Use NFLTokenGenerator if possible
 169 * **Parse additional metadata**: New option `--parse-metadata` to extract additional metadata from existing fields
 170     * The extracted fields can be used in `--output`
 171     * Deprecated `--metadata-from-title`
 172 * [Audius] Add extractor
 173 * [youtube] Extract playlist description and write it to `.description` file
 174 * Detect existing files even when using `recode`/`remux` (`extract-audio` is partially fixed)
 175 * Fix wrong user config from v2021.01.24
 176 * [youtube] Report error message from youtube as error instead of warning
 177 * [FormatSort] Fix some fields not sorting from v2021.01.24
 178 * [postprocessor] Deprecate `avconv`/`avprobe`.  All current functionality is left untouched. But don't expect any new features to work with avconv
 179 * [postprocessor] fix `write_debug` to not throw error when there is no `_downloader`
 180 * [movefiles] Don't give "cant find" warning when move is unnecessary
 181 * Refactor `update-version`, `pyinst.py` and related files
 182 * [ffmpeg] Document more formats that are supported for remux/recode
 183
 184
 185 ### 2021.01.24
 186 * **Merge youtube-dl:** Upto [2021.01.24](https://github.com/ytdl-org/youtube-dl/releases/tag/2021.01.16)
 187 * Plugin support ([documentation](https://github.com/yt-dlp/yt-dlp#plugins))
 188 * **Multiple paths**: New option `-P`/`--paths` to give different paths for different types of files
 189     * The syntax is `-P "type:path" -P "type:path"` ([documentation](https://github.com/yt-dlp/yt-dlp#:~:text=-P,%20--paths%20TYPE:PATH))
 190     * Valid types are: home, temp, description, annotation, subtitle, infojson, thumbnail
 191     * Additionally, configuration file is taken from home directory or current directory ([documentation](https://github.com/yt-dlp/yt-dlp#:~:text=Home%20Configuration))
 192 * Allow passing different arguments to different external downloaders ([documentation](https://github.com/yt-dlp/yt-dlp#:~:text=--downloader-args%20NAME:ARGS))
 193 * [mildom] Add extractor by [nao20010128nao](https://github.com/nao20010128nao)
 194 * Warn when using old style `--external-downloader-args` and `--post-processor-args`
 195 * Fix `--no-overwrite` when using `--write-link`
 196 * [sponskrub] Output `unrecognized argument` error message correctly
 197 * [cbs] Make failure to extract title non-fatal
 198 * Fix typecasting when pre-checking archive
 199 * Fix issue with setting title on UNIX
 200 * Deprecate redundant aliases in `formatSort`. The aliases remain functional for backward compatibility, but will be left undocumented
 201 * [tests] Fix test_post_hooks
 202 * [tests] Split core and download tests
 203
 204
 205 ### 2021.01.20
 206 * [TrovoLive] Add extractor (only VODs)
 207 * [pokemon] Add `/#/player` URLs
 208 * Improved parsing of multiple postprocessor-args, add `--ppa` as alias
 209 * [EmbedThumbnail] Simplify embedding in mkv
 210 * [sponskrub] Encode filenames correctly, better debug output and error message
 211 * [readme] Cleanup options
 212
 213
 214 ### 2021.01.16
 215 * **Merge youtube-dl:** Upto [2021.01.16](https://github.com/ytdl-org/youtube-dl/releases/tag/2021.01.16)
 216 * **Configuration files:**
 217     * Portable configuration file: `./yt-dlp.conf`
 218     * Allow the configuration files to be named `yt-dlp` instead of `youtube-dlc`. See [this](https://github.com/yt-dlp/yt-dlp#configuration) for details
 219 * Add PyPI release
 220
 221
 222 ### 2021.01.14
 223 * Added option `--break-on-reject`
 224 * [roosterteeth.com] Fix for bonus episodes by [Zocker1999NET](https://github.com/Zocker1999NET)
 225 * [tiktok] Fix for when share_info is empty
 226 * [EmbedThumbnail] Fix bug due to incorrect function name
 227 * [documentation] Changed sponskrub links to point to [yt-dlp/SponSkrub](https://github.com/yt-dlp/SponSkrub) since I am now providing both linux and windows releases
 228 * [documentation] Change all links to correctly point to new fork URL
 229 * [documentation] Fixes typos
 230
 231
 232 ### 2021.01.12
 233 * [roosterteeth.com] Add subtitle support by [samiksome](https://github.com/samiksome)
 234 * Added `--force-overwrites`, `--no-force-overwrites` by [alxnull](https://github.com/alxnull)
 235 * Changed fork name to `yt-dlp`
 236 * Fix typos by [FelixFrog](https://github.com/FelixFrog)
 237 * [ci] Option to skip
 238 * [changelog] Added unreleased changes in blackjack4494/yt-dlc
 239
 240
 241 ### 2021.01.10
 242 * [archive.org] Fix extractor and add support for audio and playlists by [wporr](https://github.com/wporr)
 243 * [Animelab] Added by [mariuszskon](https://github.com/mariuszskon)
 244 * [youtube:search] Fix view_count by [ohnonot](https://github.com/ohnonot)
 245 * [youtube] Show if video is embeddable in info
 246 * Update version badge automatically in README
 247 * Enable `test_youtube_search_matching`
 248 * Create `to_screen` and similar functions in postprocessor/common
 249
 250
 251 ### 2021.01.09
 252 * [youtube] Fix bug in automatic caption extraction
 253 * Add `post_hooks` to YoutubeDL by [alexmerkel](https://github.com/alexmerkel)
 254 * Batch file enumeration improvements by [glenn-slayden](https://github.com/glenn-slayden)
 255 * Stop immediately when reaching `--max-downloads` by [glenn-slayden](https://github.com/glenn-slayden)
 256 * Fix incorrect ANSI sequence for restoring console-window title by [glenn-slayden](https://github.com/glenn-slayden)
 257 * Kill child processes when yt-dlc is killed by [Unrud](https://github.com/Unrud)
 258
 259
 260 ### 2021.01.08
 261 * **Merge youtube-dl:** Upto [2021.01.08](https://github.com/ytdl-org/youtube-dl/releases/tag/2021.01.08)
 262     * Extractor stitcher ([1](https://github.com/ytdl-org/youtube-dl/commit/bb38a1215718cdf36d73ff0a7830a64cd9fa37cc), [2](https://github.com/ytdl-org/youtube-dl/commit/a563c97c5cddf55f8989ed7ea8314ef78e30107f)) have not been merged
 263 * Moved changelog to seperate file
 264
 265
 266 ### 2021.01.07-1
 267 * [Akamai] fix by [nixxo](https://github.com/nixxo)
 268 * [Tiktok] merge youtube-dl tiktok extractor by [GreyAlien502](https://github.com/GreyAlien502)
 269 * [vlive] add support for playlists by [kyuyeunk](https://github.com/kyuyeunk)
 270 * [youtube_live_chat] make sure playerOffsetMs is positive by [siikamiika](https://github.com/siikamiika)
 271 * Ignore extra data streams in ffmpeg by [jbruchon](https://github.com/jbruchon)
 272 * Allow passing different arguments to different postprocessors using `--postprocessor-args`
 273 * Deprecated `--sponskrub-args`. The same can now be done using `--postprocessor-args "sponskrub:<args>"`
 274 * [CI] Split tests into core-test and full-test
 275
 276
 277 ### 2021.01.07
 278 * Removed priority of `av01` codec in `-S` since most devices don't support it yet
 279 * Added `duration_string` to be used in `--output`
 280 * Created First Release
 281
 282
 283 ### 2021.01.05-1
 284 * **Changed defaults:**
 285     * Enabled `--ignore`
 286     * Disabled `--video-multistreams` and `--audio-multistreams`
 287     * Changed default format selection to `bv*+ba/b` when `--audio-multistreams` is disabled
 288     * Changed default format sort order to `res,fps,codec,size,br,asr,proto,ext,has_audio,source,format_id`
 289     * Changed `webm` to be more preferable than `flv` in format sorting
 290     * Changed default output template to `%(title)s [%(id)s].%(ext)s`
 291     * Enabled `--list-formats-as-table`
 292
 293
 294 ### 2021.01.05
 295 * **Format Sort:** Added `--format-sort` (`-S`), `--format-sort-force` (`--S-force`) - See [Sorting Formats](README.md#sorting-formats) for details
 296 * **Format Selection:** See [Format Selection](README.md#format-selection) for details
 297     * New format selectors: `best*`, `worst*`, `bestvideo*`, `bestaudio*`, `worstvideo*`, `worstaudio*`
 298     * Changed video format sorting to show video only files and video+audio files together.
 299     * Added `--video-multistreams`, `--no-video-multistreams`, `--audio-multistreams`, `--no-audio-multistreams`
 300     * Added `b`,`w`,`v`,`a` as alias for `best`, `worst`, `video` and `audio` respectively
 301 * **Shortcut Options:** Added `--write-link`, `--write-url-link`, `--write-webloc-link`, `--write-desktop-link` by [h-h-h-h](https://github.com/h-h-h-h) - See [Internet Shortcut Options](README.md#internet-shortcut-options) for details
 302 * **Sponskrub integration:** Added `--sponskrub`, `--sponskrub-cut`, `--sponskrub-force`, `--sponskrub-location`, `--sponskrub-args` - See [SponSkrub Options](README.md#sponskrub-sponsorblock-options) for details
 303 * Added `--force-download-archive` (`--force-write-archive`) by [h-h-h-h](https://github.com/h-h-h-h)
 304 * Added `--list-formats-as-table`,  `--list-formats-old`
 305 * **Negative Options:** Makes it possible to negate most boolean options by adding a `no-` to the switch. Usefull when you want to reverse an option that is defined in a config file
 306     * Added `--no-ignore-dynamic-mpd`, `--no-allow-dynamic-mpd`, `--allow-dynamic-mpd`, `--youtube-include-hls-manifest`, `--no-youtube-include-hls-manifest`, `--no-youtube-skip-hls-manifest`, `--no-download`, `--no-download-archive`, `--resize-buffer`, `--part`, `--mtime`, `--no-keep-fragments`, `--no-cookies`, `--no-write-annotations`, `--no-write-info-json`, `--no-write-description`, `--no-write-thumbnail`, `--youtube-include-dash-manifest`, `--post-overwrites`, `--no-keep-video`, `--no-embed-subs`, `--no-embed-thumbnail`, `--no-add-metadata`, `--no-include-ads`, `--no-write-sub`, `--no-write-auto-sub`, `--no-playlist-reverse`, `--no-restrict-filenames`, `--youtube-include-dash-manifest`, `--no-format-sort-force`, `--flat-videos`, `--no-list-formats-as-table`, `--no-sponskrub`, `--no-sponskrub-cut`, `--no-sponskrub-force`
 307     * Renamed: `--write-subs`, `--no-write-subs`, `--no-write-auto-subs`, `--write-auto-subs`. Note that these can still be used without the ending "s"
 308 * Relaxed validation for format filters so that any arbitrary field can be used
 309 * Fix for embedding thumbnail in mp3 by [pauldubois98](https://github.com/pauldubois98) ([ytdl-org/youtube-dl#21569](https://github.com/ytdl-org/youtube-dl/pull/21569))
 310 * Make Twitch Video ID output from Playlist and VOD extractor same. This is only a temporary fix
 311 * **Merge youtube-dl:** Upto [2021.01.03](https://github.com/ytdl-org/youtube-dl/commit/8e953dcbb10a1a42f4e12e4e132657cb0100a1f8) - See [blackjack4494/yt-dlc#280](https://github.com/blackjack4494/yt-dlc/pull/280) for details
 312     * Extractors [tiktok](https://github.com/ytdl-org/youtube-dl/commit/fb626c05867deab04425bad0c0b16b55473841a2) and [hotstar](https://github.com/ytdl-org/youtube-dl/commit/bb38a1215718cdf36d73ff0a7830a64cd9fa37cc) have not been merged
 313 * Cleaned up the fork for public use
 314
 315
 316 ### Unreleased changes in [blackjack4494/yt-dlc](https://github.com/blackjack4494/yt-dlc)
 317 * Updated to youtube-dl release 2020.11.26
 318 * [youtube]
 319     * Implemented all Youtube Feeds (ytfav, ytwatchlater, ytsubs, ythistory, ytrec) and SearchURL
 320     * Fix ytsearch not returning results sometimes due to promoted content
 321     * Temporary fix for automatic captions - disable json3
 322     * Fix some improper Youtube URLs
 323     * Redirect channel home to /video
 324     * Print youtube's warning message
 325     * Multiple pages are handled better for feeds
 326 * Add --break-on-existing by [gergesh](https://github.com/gergesh)
 327 * Pre-check video IDs in the archive before downloading
 328 * [bitwave.tv] New extractor
 329 * [Gedi] Add extractor
 330 * [Rcs] Add new extractor
 331 * [skyit] Add support for multiple Sky Italia website and removed old skyitalia extractor
 332 * [france.tv] Fix thumbnail URL
 333 * [ina] support mobile links
 334 * [instagram] Fix extractor
 335 * [itv] BTCC new pages' URL update (articles instead of races)
 336 * [SouthparkDe] Support for English URLs
 337 * [spreaker] fix SpreakerShowIE test URL
 338 * [Vlive] Fix playlist handling when downloading a channel
 339 * [generic] Detect embedded bitchute videos
 340 * [generic] Extract embedded youtube and twitter videos
 341 * [ffmpeg] Ensure all streams are copied
 342 * Fix for os.rename error when embedding thumbnail to video in a different drive
 343 * make_win.bat: don't use UPX to pack vcruntime140.dll