]> jfr.im git - yt-dlp.git/blame - README.md
[Makefile] Ensure that offline test really is offline
[yt-dlp.git] / README.md
CommitLineData
94eb2dd1 1youtube-dl - download videos from youtube.com or other video platforms
6bcd846b 2
cfcec693
FV
3# SYNOPSIS
4**youtube-dl** [OPTIONS] URL [URL...]
5
d19bb9c0
PH
6# INSTALLATION
7
8To install it right away for all UNIX users (Linux, OS X, etc.), type:
9
10 sudo curl https://yt-dl.org/latest/youtube-dl -o /usr/local/bin/youtube-dl
11 sudo chmod a+x /usr/local/bin/youtube-dl
12
13If you do not have curl, you can alternatively use a recent wget:
14
6e74521d 15 sudo wget https://yt-dl.org/downloads/latest/youtube-dl -O /usr/local/bin/youtube-dl
d19bb9c0
PH
16 sudo chmod a+x /usr/local/bin/youtube-dl
17
18Windows users can [download a .exe file](https://yt-dl.org/latest/youtube-dl.exe) and place it in their home directory or any other location on their [PATH](http://en.wikipedia.org/wiki/PATH_%28variable%29).
19
3b95347b
PH
20OS X users can install **youtube-dl** with [Homebrew](http://brew.sh/).
21
22 brew install youtube-dl
23
24You can also use pip:
25
26 sudo pip install youtube-dl
27
d19bb9c0
PH
28Alternatively, refer to the developer instructions below for how to check out and work with the git repository. For further options, including PGP signatures, see https://rg3.github.io/youtube-dl/download.html .
29
cfcec693 30# DESCRIPTION
6bcd846b
DB
31**youtube-dl** is a small command-line program to download videos from
32YouTube.com and a few more sites. It requires the Python interpreter, version
a03aaaed 332.6, 2.7, or 3.2+, and it is not platform specific. It should work on
280d6789 34your Unix box, on Windows or on Mac OS X. It is released to the public domain,
6bcd846b
DB
35which means you can modify it, redistribute it or use it however you like.
36
cfcec693 37# OPTIONS
780083db
PH
38 -h, --help print this help text and exit
39 --version print program version and exit
40 -U, --update update this program to latest version. Make
41 sure that you have sufficient permissions
42 (run with sudo if needed)
43 -i, --ignore-errors continue on download errors, for example to
98c4b8fa 44 skip unavailable videos in a playlist
780083db
PH
45 --abort-on-error Abort downloading of further videos (in the
46 playlist or the command line) if an error
47 occurs
48 --dump-user-agent display the current browser identification
780083db
PH
49 --list-extractors List all supported extractors and the URLs
50 they would handle
51 --extractor-descriptions Output descriptions of all supported
52 extractors
53 --proxy URL Use the specified HTTP/HTTPS proxy. Pass in
54 an empty string (--proxy "") for direct
55 connection
780083db 56 --socket-timeout None Time to wait before giving up, in seconds
780083db
PH
57 --default-search PREFIX Use this prefix for unqualified URLs. For
58 example "gvsearch2:" downloads two videos
59 from google videos for youtube-dl "large
f4d66a99 60 apple". Use the value "auto" to let
4f31d0f2
PH
61 youtube-dl guess ("auto_warning" to emit a
62 warning when guessing). "error" just throws
63 an error. The default value "fixup_error"
64 repairs broken URLs, but emits an error if
65 this is not possible instead of searching.
9d3ac744
PH
66 --ignore-config Do not read configuration files. When given
67 in the global configuration file /etc
9776bc7f
PH
68 /youtube-dl.conf: Do not read the user
69 configuration in ~/.config/youtube-
70 dl/config (%APPDATA%/youtube-dl/config.txt
71 on Windows)
36f1c904
PH
72 --flat-playlist Do not extract the videos of a playlist,
73 only list them.
08c1d0d3 74
cfcec693 75## Video Selection:
780083db
PH
76 --playlist-start NUMBER playlist video to start at (default is 1)
77 --playlist-end NUMBER playlist video to end at (default is last)
78 --match-title REGEX download only matching titles (regex or
79 caseless sub-string)
80 --reject-title REGEX skip download for matching titles (regex or
81 caseless sub-string)
82 --max-downloads NUMBER Abort after downloading NUMBER files
83 --min-filesize SIZE Do not download any videos smaller than
84 SIZE (e.g. 50k or 44.6m)
85 --max-filesize SIZE Do not download any videos larger than SIZE
86 (e.g. 50k or 44.6m)
87 --date DATE download only videos uploaded in this date
88 --datebefore DATE download only videos uploaded on or before
89 this date (i.e. inclusive)
90 --dateafter DATE download only videos uploaded on or after
91 this date (i.e. inclusive)
92 --min-views COUNT Do not download any videos with less than
93 COUNT views
94 --max-views COUNT Do not download any videos with more than
95 COUNT views
acda92f6
PH
96 --no-playlist If the URL refers to a video and a
97 playlist, download only the video.
780083db
PH
98 --age-limit YEARS download only videos suitable for the given
99 age
100 --download-archive FILE Download only videos not listed in the
101 archive file. Record the IDs of all
102 downloaded videos in it.
103 --include-ads Download advertisements as well
104 (experimental)
6bcd846b 105
d5a62e4f 106## Download Options:
780083db
PH
107 -r, --rate-limit LIMIT maximum download rate in bytes per second
108 (e.g. 50K or 4.2M)
109 -R, --retries RETRIES number of retries (default is 10)
110 --buffer-size SIZE size of download buffer (e.g. 1024 or 16K)
111 (default is 1024)
112 --no-resize-buffer do not automatically adjust the buffer
113 size. By default, the buffer size is
114 automatically resized from an initial value
115 of SIZE.
2101f5d4 116 --playlist-reverse Download playlist videos in reverse order
d5a62e4f 117
cfcec693 118## Filesystem Options:
36f35428
PH
119 -a, --batch-file FILE file containing URLs to download ('-' for
120 stdin)
780083db 121 --id use only video ID in file name
780083db
PH
122 -o, --output TEMPLATE output filename template. Use %(title)s to
123 get the title, %(uploader)s for the
124 uploader name, %(uploader_id)s for the
125 uploader nickname if different,
126 %(autonumber)s to get an automatically
127 incremented number, %(ext)s for the
128 filename extension, %(format)s for the
129 format description (like "22 - 1280x720" or
130 "HD"), %(format_id)s for the unique id of
131 the format (like Youtube's itags: "137"),
132 %(upload_date)s for the upload date
133 (YYYYMMDD), %(extractor)s for the provider
134 (youtube, metacafe, etc), %(id)s for the
1d4df56d
PH
135 video id, %(playlist_title)s,
136 %(playlist_id)s, or %(playlist)s (=title if
137 present, ID otherwise) for the playlist the
780083db 138 video is in, %(playlist_index)s for the
1d4df56d
PH
139 position in the playlist. %(height)s and
140 %(width)s for the width and height of the
141 video format. %(resolution)s for a textual
d63516e9 142 description of the resolution of the video
1d4df56d
PH
143 format. %% for a literal percent. Use - to
144 output to stdout. Can also be used to
145 download to a different directory, for
146 example with -o '/my/downloads/%(uploader)s
147 /%(title)s-%(id)s.%(ext)s' .
780083db
PH
148 --autonumber-size NUMBER Specifies the number of digits in
149 %(autonumber)s when it is present in output
150 filename template or --auto-number option
151 is given
152 --restrict-filenames Restrict filenames to only ASCII
153 characters, and avoid "&" and spaces in
154 filenames
2101f5d4
PH
155 -A, --auto-number [deprecated; use -o
156 "%(autonumber)s-%(title)s.%(ext)s" ] number
157 downloaded files starting from 00000
36f35428
PH
158 -t, --title [deprecated] use title in file name
159 (default)
160 -l, --literal [deprecated] alias of --title
780083db
PH
161 -w, --no-overwrites do not overwrite files
162 -c, --continue force resume of partially downloaded files.
163 By default, youtube-dl will resume
164 downloads if possible.
165 --no-continue do not resume partially downloaded files
166 (restart from beginning)
9b36dcbd
PH
167 --no-part do not use .part files - write directly
168 into output file
780083db
PH
169 --no-mtime do not use the Last-modified header to set
170 the file modification time
171 --write-description write video description to a .description
172 file
173 --write-info-json write video metadata to a .info.json file
174 --write-annotations write video annotations to a .annotation
175 file
176 --write-thumbnail write thumbnail image to disk
36f35428
PH
177 --load-info FILE json file containing the video information
178 (created with the "--write-json" option)
179 --cookies FILE file to read cookies from and dump cookie
180 jar in
181 --cache-dir DIR Location in the filesystem where youtube-dl
182 can store some downloaded information
183 permanently. By default $XDG_CACHE_HOME
184 /youtube-dl or ~/.cache/youtube-dl . At the
185 moment, only YouTube player files (for
186 videos with obfuscated signatures) are
187 cached, but that may change.
188 --no-cache-dir Disable filesystem caching
189 --rm-cache-dir Delete all filesystem cache files
6bcd846b 190
cfcec693 191## Verbosity / Simulation Options:
780083db 192 -q, --quiet activates quiet mode
6c072e7d 193 --no-warnings Ignore warnings
780083db
PH
194 -s, --simulate do not download the video and do not write
195 anything to disk
196 --skip-download do not download the video
197 -g, --get-url simulate, quiet but print URL
198 -e, --get-title simulate, quiet but print title
199 --get-id simulate, quiet but print id
200 --get-thumbnail simulate, quiet but print thumbnail URL
201 --get-description simulate, quiet but print video description
202 --get-duration simulate, quiet but print video length
203 --get-filename simulate, quiet but print output filename
204 --get-format simulate, quiet but print output format
bf30f3bd
PH
205 -j, --dump-json simulate, quiet but print JSON information.
206 See --output for a description of available
207 keys.
724d0318
PH
208 -J, --dump-single-json simulate, quiet but print JSON information
209 for each command-line argument. If the URL
210 refers to a playlist, dump the whole
211 playlist information in a single line.
780083db
PH
212 --newline output progress bar as new lines
213 --no-progress do not print progress bar
214 --console-title display progress in console titlebar
215 -v, --verbose print various debugging information
216 --dump-intermediate-pages print downloaded pages to debug problems
217 (very verbose)
218 --write-pages Write downloaded intermediary pages to
219 files in the current directory to debug
220 problems
221 --print-traffic Display sent and read HTTP traffic
6bcd846b 222
36f35428
PH
223## Workarounds:
224 --encoding ENCODING Force the specified encoding (experimental)
225 --no-check-certificate Suppress HTTPS certificate validation.
226 --prefer-insecure Use an unencrypted connection to retrieve
227 information about the video. (Currently
228 supported only for YouTube)
229 --user-agent UA specify a custom user agent
9b36dcbd 230 --referer URL specify a custom referer, use if the video
36f35428
PH
231 access is restricted to one domain
232 --add-header FIELD:VALUE specify a custom HTTP header and its value,
233 separated by a colon ':'. You can use this
234 option multiple times
4f31d0f2
PH
235 --bidi-workaround Work around terminals that lack
236 bidirectional text support. Requires bidiv
237 or fribidi executable in PATH
36f35428 238
cfcec693 239## Video Format Options:
780083db 240 -f, --format FORMAT video format code, specify the order of
fd78a4d3
PH
241 preference using slashes: -f 22/17/18 . -f
242 mp4 , -f m4a and -f flv are also
243 supported. You can also use the special
244 names "best", "bestvideo", "bestaudio",
245 "worst", "worstvideo" and "worstaudio". By
246 default, youtube-dl will pick the best
247 quality. Use commas to download multiple
1d4df56d
PH
248 audio formats, such as -f
249 136/137/mp4/bestvideo,140/m4a/bestaudio.
250 You can merge the video and audio of two
251 formats into a single file using -f <video-
252 format>+<audio-format> (requires ffmpeg or
253 avconv), for example -f
254 bestvideo+bestaudio.
780083db
PH
255 --all-formats download all available video formats
256 --prefer-free-formats prefer free video formats unless a specific
257 one is requested
258 --max-quality FORMAT highest quality format to download
259 -F, --list-formats list all available formats
9b36dcbd
PH
260 --youtube-skip-dash-manifest Do not download the DASH manifest on
261 YouTube videos
8ae7be3e
PH
262
263## Subtitle Options:
780083db
PH
264 --write-sub write subtitle file
265 --write-auto-sub write automatic subtitle file (youtube
266 only)
267 --all-subs downloads all the available subtitles of
268 the video
269 --list-subs lists all available subtitles for the video
270 --sub-format FORMAT subtitle format (default=srt) ([sbv/vtt]
271 youtube only)
272 --sub-lang LANGS languages of the subtitles to download
273 (optional) separated by commas, use IETF
274 language tags like 'en,pt'
6bcd846b 275
cfcec693 276## Authentication Options:
9b36dcbd 277 -u, --username USERNAME login with this account ID
780083db 278 -p, --password PASSWORD account password
b8313f07 279 -2, --twofactor TWOFACTOR two-factor auth code
780083db
PH
280 -n, --netrc use .netrc authentication data
281 --video-password PASSWORD video password (vimeo, smotri)
6bcd846b 282
cfcec693 283## Post-processing Options:
780083db
PH
284 -x, --extract-audio convert video files to audio-only files
285 (requires ffmpeg or avconv and ffprobe or
286 avprobe)
287 --audio-format FORMAT "best", "aac", "vorbis", "mp3", "m4a",
9b36dcbd 288 "opus", or "wav"; "best" by default
780083db
PH
289 --audio-quality QUALITY ffmpeg/avconv audio quality specification,
290 insert a value between 0 (better) and 9
291 (worse) for VBR or a specific bitrate like
292 128K (default 5)
293 --recode-video FORMAT Encode the video to another format if
294 necessary (currently supported:
09018e19 295 mp4|flv|ogg|webm|mkv)
780083db
PH
296 -k, --keep-video keeps the video file on disk after the
297 post-processing; the video is erased by
298 default
299 --no-post-overwrites do not overwrite post-processed files; the
300 post-processed files are overwritten by
301 default
302 --embed-subs embed subtitles in the video (only for mp4
303 videos)
d0f2ab69 304 --embed-thumbnail embed thumbnail in the audio as cover art
780083db
PH
305 --add-metadata write metadata to the video file
306 --xattrs write metadata to the video file's xattrs
307 (using dublin core and xdg standards)
308 --prefer-avconv Prefer avconv over ffmpeg for running the
309 postprocessors (default)
310 --prefer-ffmpeg Prefer ffmpeg over avconv for running the
311 postprocessors
067e9222
PH
312 --exec CMD Execute a command on the file after
313 downloading, similar to find's -exec
314 syntax. Example: --exec 'adb push {}
315 /sdcard/Music/ && rm {}'
6bcd846b 316
df4bad32
PH
317# CONFIGURATION
318
fe52f9f9 319You can configure youtube-dl by placing default arguments (such as `--extract-audio --no-mtime` to always extract the audio and not copy the mtime) into `/etc/youtube-dl.conf` and/or `~/.config/youtube-dl/config`. On Windows, the configuration file locations are `%APPDATA%\youtube-dl\config.txt` and `C:\Users\<Yourname>\youtube-dl.conf`.
df4bad32 320
02531431
PH
321# OUTPUT TEMPLATE
322
323The `-o` option allows users to indicate a template for the output file names. The basic usage is not to set any template arguments when downloading a single file, like in `youtube-dl -o funny_video.flv "http://some/video"`. However, it may contain special sequences that will be replaced when downloading each video. The special sequences have the format `%(NAME)s`. To clarify, that is a percent symbol followed by a name in parenthesis, followed by a lowercase S. Allowed names are:
324
325 - `id`: The sequence will be replaced by the video identifier.
326 - `url`: The sequence will be replaced by the video URL.
327 - `uploader`: The sequence will be replaced by the nickname of the person who uploaded the video.
328 - `upload_date`: The sequence will be replaced by the upload date in YYYYMMDD format.
329 - `title`: The sequence will be replaced by the video title.
877f4c45
PH
330 - `ext`: The sequence will be replaced by the appropriate extension (like flv or mp4).
331 - `epoch`: The sequence will be replaced by the Unix epoch when creating the file.
332 - `autonumber`: The sequence will be replaced by a five-digit number that will be increased with each download, starting at zero.
7eab8dc7 333 - `playlist`: The name or the id of the playlist that contains the video.
d281274b 334 - `playlist_index`: The index of the video in the playlist, a five-digit number.
02531431 335
1083705f 336The current default template is `%(title)s-%(id)s.%(ext)s`.
02531431
PH
337
338In some cases, you don't want special characters such as 中, spaces, or &, such as when transferring the downloaded filename to a Windows system or the filename through an 8bit-unsafe channel. In these cases, add the `--restrict-filenames` flag to get a shorter title:
339
1ce464ab
EJ
340```bash
341$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc
342youtube-dl test video ''_ä↭𝕐.mp4 # All kinds of weird characters
343$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc --restrict-filenames
344youtube-dl_test_video_.mp4 # A simple file name
345```
02531431 346
e31852ab
JMF
347# VIDEO SELECTION
348
349Videos can be filtered by their upload date using the options `--date`, `--datebefore` or `--dateafter`, they accept dates in two formats:
350
351 - Absolute dates: Dates in the format `YYYYMMDD`.
352 - Relative dates: Dates in the format `(now|today)[+-][0-9](day|week|month|year)(s)?`
353
354Examples:
355
1ce464ab
EJ
356```bash
357# Download only the videos uploaded in the last 6 months
358$ youtube-dl --dateafter now-6months
09c4d509 359
1ce464ab
EJ
360# Download only the videos uploaded on January 1, 1970
361$ youtube-dl --date 19700101
09c4d509 362
1ce464ab
EJ
363$ # will only download the videos uploaded in the 200x decade
364$ youtube-dl --dateafter 20000101 --datebefore 20091231
365```
e31852ab 366
cfcec693 367# FAQ
447b1d71 368
89294b5f 369### How do I update youtube-dl?
573585c2 370
89294b5f
PH
371If you've followed [our manual installation instructions](http://rg3.github.io/youtube-dl/download.html), you can simply run `youtube-dl -U` (or, on Linux, `sudo youtube-dl -U`).
372
373If you have used pip, a simple `sudo pip install -U youtube-dl` is sufficient to update.
573585c2 374
89294b5f 375If you have installed youtube-dl using a package manager like *apt-get* or *yum*, use the standard system update mechanism to update. Note that distribution packages are often outdated. As a rule of thumb, youtube-dl releases at least once a month, and often weekly or even daily. Simply go to http://yt-dl.org/ to find out the current version. Unfortunately, there is nothing we youtube-dl developers can do if your distributions serves a really outdated version. You can (and should) complain to your distribution in their bugtracker or support forum.
573585c2 376
89294b5f
PH
377As a last resort, you can also uninstall the version installed by your package manager and follow our manual installation instructions. For that, remove the distribution's package, with a line like
378
379 sudo apt-get remove -y youtube-dl
380
381Afterwards, simply follow [our manual installation instructions](http://rg3.github.io/youtube-dl/download.html):
573585c2
PH
382
383```
573585c2
PH
384sudo wget https://yt-dl.org/latest/youtube-dl -O /usr/local/bin/youtube-dl
385sudo chmod a+x /usr/local/bin/youtube-dl
386hash -r
387```
388
89294b5f
PH
389Again, from then on you'll be able to update with `sudo youtube-dl -U`.
390
391### I'm getting an error `Unable to extract OpenGraph title` on YouTube playlists
392
393YouTube changed their playlist format in March 2014 and later on, so you'll need at least youtube-dl 2014.07.25 to download all YouTube videos.
394
08965906 395If you have installed youtube-dl with a package manager, pip, setup.py or a tarball, please use that to update. Note that Ubuntu packages do not seem to get updated anymore. Since we are not affiliated with Ubuntu, there is little we can do. Feel free to [report bugs](https://bugs.launchpad.net/ubuntu/+source/youtube-dl/+filebug) to the [Ubuntu packaging guys](mailto:ubuntu-motu@lists.ubuntu.com?subject=outdated%20version%20of%20youtube-dl) - all they have to do is update the package to a somewhat recent version. See above for a way to update.
89294b5f 396
573585c2
PH
397### Do I always have to pass in `--max-quality FORMAT`, or `-citw`?
398
399By default, youtube-dl intends to have the best options (incidentally, if you have a convincing case that these should be different, [please file an issue where you explain that](https://yt-dl.org/bug)). Therefore, it is unnecessary and sometimes harmful to copy long option strings from webpages. In particular, `--max-quality` *limits* the video quality (so if you want the best quality, do NOT pass it in), and the only option out of `-citw` that is regularly useful is `-i`.
400
447b1d71
PH
401### Can you please put the -b option back?
402
2e1b3afe 403Most people asking this question are not aware that youtube-dl now defaults to downloading the highest available quality as reported by YouTube, which will be 1080p or 720p in some cases, so you no longer need the `-b` option. For some specific videos, maybe YouTube does not report them to be available in a specific high quality format you're interested in. In that case, simply request it with the `-f` option and youtube-dl will try to download it.
447b1d71 404
f2a3a352 405### I get HTTP error 402 when trying to download a video. What's this?
447b1d71 406
2e1b3afe 407Apparently YouTube requires you to pass a CAPTCHA test if you download too much. We're [considering to provide a way to let you solve the CAPTCHA](https://github.com/rg3/youtube-dl/issues/154), but at the moment, your best course of action is pointing a webbrowser to the youtube URL, solving the CAPTCHA, and restart youtube-dl.
447b1d71
PH
408
409### I have downloaded a video but how can I play it?
410
411Once the video is fully downloaded, use any video player, such as [vlc](http://www.videolan.org) or [mplayer](http://www.mplayerhq.hu/).
412
413### The links provided by youtube-dl -g are not working anymore
414
a0432a1e 415The URLs youtube-dl outputs require the downloader to have the correct cookies. Use the `--cookies` option to write the required cookies into a file, and advise your downloader to read cookies from that file. Some sites also require a common user agent to be used, use `--dump-user-agent` to see the one in use by youtube-dl.
447b1d71 416
454d6691
PH
417### ERROR: no fmt_url_map or conn information found in video info
418
5a2ba45e 419youtube has switched to a new video info format in July 2011 which is not supported by old versions of youtube-dl. You can update youtube-dl with `sudo youtube-dl --update`.
454d6691 420
6c5b442a
PH
421### ERROR: unable to download video ###
422
423youtube requires an additional signature since September 2012 which is not supported by old versions of youtube-dl. You can update youtube-dl with `sudo youtube-dl --update`.
424
5cdfaeb3 425### SyntaxError: Non-ASCII character ###
6c5b442a
PH
426
427The error
428
429 File "youtube-dl", line 2
430 SyntaxError: Non-ASCII character '\x93' ...
431
432means you're using an outdated version of Python. Please update to Python 2.6 or 2.7.
433
5cdfaeb3
FV
434### What is this binary file? Where has the code gone?
435
71f36332 436Since June 2012 (#342) youtube-dl is packed as an executable zipfile, simply unzip it (might need renaming to `youtube-dl.zip` first on some systems) or clone the git repository, as laid out above. If you modify the code, you can run it by executing the `__main__.py` file. To recompile the executable, run `make youtube-dl`.
5cdfaeb3 437
ce367443
FV
438### The exe throws a *Runtime error from Visual C++*
439
440To run the exe you need to install first the [Microsoft Visual C++ 2008 Redistributable Package](http://www.microsoft.com/en-us/download/details.aspx?id=29).
441
a96ed916 442# DEVELOPER INSTRUCTIONS
803abae2 443
63ef36e8 444Most users do not need to build youtube-dl and can [download the builds](http://rg3.github.io/youtube-dl/download.html) or get them from their distribution.
803abae2 445
63ef36e8
PH
446To run youtube-dl as a developer, you don't need to build anything either. Simply execute
447
448 python -m youtube_dl
449
450To run the test, simply invoke your favorite test runner, or execute a test file directly; any of the following work:
451
452 python -m unittest discover
453 python test/test_download.py
454 nosetests
455
456If you want to create a build of youtube-dl yourself, you'll need
457
458* python
459* make
460* pandoc
461* zip
462* nosetests
6bcd846b 463
a96ed916
PH
464### Adding support for a new site
465
5fbd672c
PH
466If you want to add support for a new site, you can follow this quick list (assuming your service is called `yourextractor`):
467
4681. [Fork this repository](https://github.com/rg3/youtube-dl/fork)
4692. Check out the source code with `git clone git@github.com:YOUR_GITHUB_USERNAME/youtube-dl.git`
4703. Start a new git branch with `cd youtube-dl; git checkout -b yourextractor`
4714. Start with this simple template and save it to `youtube_dl/extractor/yourextractor.py`:
1ce464ab
EJ
472 ```python
473 # coding: utf-8
474 from __future__ import unicode_literals
475
1ce464ab
EJ
476 from .common import InfoExtractor
477
478
479 class YourExtractorIE(InfoExtractor):
480 _VALID_URL = r'https?://(?:www\.)?yourextractor\.com/watch/(?P<id>[0-9]+)'
481 _TEST = {
482 'url': 'http://yourextractor.com/watch/42',
7f5c0c4a 483 'md5': 'TODO: md5 sum of the first 10241 bytes of the video file (use --test)',
1ce464ab
EJ
484 'info_dict': {
485 'id': '42',
486 'ext': 'mp4',
487 'title': 'Video title goes here',
218f7549 488 'thumbnail': 're:^https?://.*\.jpg$',
1ce464ab
EJ
489 # TODO more properties, either as:
490 # * A value
491 # * MD5 checksum; start the string with md5:
492 # * A regular expression; start the string with re:
493 # * Any Python type (for example int or float)
5fbd672c 494 }
1ce464ab 495 }
5fbd672c 496
1ce464ab 497 def _real_extract(self, url):
4bc77c84 498 video_id = self._match_id(url)
c920d7f0 499 webpage = self._download_webpage(url, video_id)
5fbd672c 500
1ce464ab 501 # TODO more code goes here, for example ...
1ce464ab 502 title = self._html_search_regex(r'<h1>(.*?)</h1>', webpage, 'title')
d1b3e3dd 503
1ce464ab
EJ
504 return {
505 'id': video_id,
506 'title': title,
c3e74731 507 'description': self._og_search_description(webpage),
1ce464ab
EJ
508 # TODO more properties (see youtube_dl/extractor/common.py)
509 }
510 ```
5fbd672c 5115. Add an import in [`youtube_dl/extractor/__init__.py`](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/__init__.py).
ace52c57 5126. Run `python test/test_download.py TestDownload.test_YourExtractor`. This *should fail* at first, but you can continually re-run it until you're done. If you decide to add more than one test, then rename ``_TEST`` to ``_TESTS`` and make it into a list of dictionaries. The tests will be then be named `TestDownload.test_YourExtractor`, `TestDownload.test_YourExtractor_1`, `TestDownload.test_YourExtractor_2`, etc.
5fbd672c
PH
5137. Have a look at [`youtube_dl/common/extractor/common.py`](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/common.py) for possible helper methods and a [detailed description of what your extractor should return](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/common.py#L38). Add tests and code for as many as you want.
5148. If you can, check the code with [pyflakes](https://pypi.python.org/pypi/pyflakes) (a good idea) and [pep8](https://pypi.python.org/pypi/pep8) (optional, ignore E501).
982a58d0 5159. When the tests pass, [add](http://git-scm.com/docs/git-add) the new files and [commit](http://git-scm.com/docs/git-commit) them and [push](http://git-scm.com/docs/git-push) the result, like this:
5fbd672c
PH
516
517 $ git add youtube_dl/extractor/__init__.py
518 $ git add youtube_dl/extractor/yourextractor.py
519 $ git commit -m '[yourextractor] Add new extractor'
520 $ git push origin yourextractor
521
52210. Finally, [create a pull request](https://help.github.com/articles/creating-a-pull-request). We'll then review and merge it.
523
524In any case, thank you very much for your contributions!
a96ed916 525
03df7baa
PH
526# EMBEDDING YOUTUBE-DL
527
528youtube-dl makes the best effort to be a good command-line program, and thus should be callable from any programming language. If you encounter any problems parsing its output, feel free to [create a report](https://github.com/rg3/youtube-dl/issues/new).
529
530From a Python program, you can embed youtube-dl in a more powerful fashion, like this:
531
532 import youtube_dl
533
534 ydl_opts = {}
535 with youtube_dl.YoutubeDL(ydl_opts) as ydl:
536 ydl.download(['http://www.youtube.com/watch?v=BaW_jenozKc'])
537
538Most likely, you'll want to use various options. For a list of what can be done, have a look at [youtube_dl/YoutubeDL.py](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/YoutubeDL.py#L69). For a start, if you want to intercept youtube-dl's output, set a `logger` object.
539
cfcec693 540# BUGS
e133e121 541
b3efb3eb 542Bugs and suggestions should be reported at: <https://github.com/rg3/youtube-dl/issues> . Unless you were prompted so or there is another pertinent reason (e.g. GitHub fails to accept the bug report), please do not send bug reports via personal email. For discussions, join us in the irc channel #youtube-dl on freenode.
e133e121 543
2a18bc9a 544Please include the full output of the command when run with `--verbose`. The output (including the first lines) contain important debugging information. Issues without the full output are often not reproducible and therefore do not get solved in short order, if ever.
4b235346 545
b3efb3eb 546Please re-read your issue once again to avoid a couple of common mistakes (you can and should use this as a checklist):
2a18bc9a
PH
547
548### Is the description of the issue itself sufficient?
549
550We often get issue reports that we cannot really decipher. While in most cases we eventually get the required information after asking back multiple times, this poses an unnecessary drain on our resources. Many contributors, including myself, are also not native speakers, so we may misread some parts.
551
552So please elaborate on what feature you are requesting, or what bug you want to be fixed. Make sure that it's obvious
553
554- What the problem is
555- How it could be fixed
556- How your proposed solution would look like
557
558If your report is shorter than two lines, it is almost certainly missing some of these, which makes it hard for us to respond to it. We're often too polite to close the issue outright, but the missing info makes misinterpretation likely. As a commiter myself, I often get frustrated by these issues, since the only possible way for me to move forward on them is to ask for clarification over and over.
559
560For bug reports, this means that your report should contain the *complete* output of youtube-dl when called with the -v flag. The error message you get for (most) bugs even says so, but you would not believe how many of our bug reports do not contain this information.
561
3ef79a97 562Site support requests **must contain an example URL**. An example URL is a URL you might want to download, like http://www.youtube.com/watch?v=BaW_jenozKc . There should be an obvious video present. Except under very special circumstances, the main page of a video service (e.g. http://www.youtube.com/ ) is *not* an example URL.
2a18bc9a
PH
563
564### Are you using the latest version?
565
3d97cbbd 566Before reporting any issue, type youtube-dl -U. This should report that you're up-to-date. About 20% of the reports we receive are already fixed, but people are using outdated versions. This goes for feature requests as well.
2a18bc9a
PH
567
568### Is the issue already documented?
569
570Make sure that someone has not already opened the issue you're trying to open. Search at the top of the window or at https://github.com/rg3/youtube-dl/search?type=Issues . If there is an issue, feel free to write something along the lines of "This affects me as well, with version 2015.01.01. Here is some more information on the issue: ...". While some issues may be old, a new post into them often spurs rapid activity.
571
572### Why are existing options not enough?
573
574Before requesting a new feature, please have a quick peek at [the list of supported options](https://github.com/rg3/youtube-dl/blob/master/README.md#synopsis). Many feature requests are for features that actually exist already! Please, absolutely do show off your work in the issue report and detail how the existing similar options do *not* solve your problem.
575
576### Is there enough context in your bug report?
577
578People want to solve problems, and often think they do us a favor by breaking down their larger problems (e.g. wanting to skip already downloaded files) to a specific request (e.g. requesting us to look whether the file exists before downloading the info page). However, what often happens is that they break down the problem into two steps: One simple, and one impossible (or extremely complicated one).
579
580We are then presented with a very complicated request when the original problem could be solved far easier, e.g. by recording the downloaded video IDs in a separate file. To avoid this, you must include the greater context where it is non-obvious. In particular, every feature request that does not consist of adding support for a new site should contain a use case scenario that explains in what situation the missing feature would be useful.
581
582### Does the issue involve one problem, and one problem only?
583
584Some of our users seem to think there is a limit of issues they can or should open. There is no limit of issues they can or should open. While it may seem appealing to be able to dump all your issues into one ticket, that means that someone who solves one of your issues cannot mark the issue as closed. Typically, reporting a bunch of issues leads to the ticket lingering since nobody wants to attack that behemoth, until someone mercifully splits the issue into multiple ones.
585
586In particular, every site support request issue should only pertain to services at one site (generally under a common domain, but always using the same backend technology). Do not request support for vimeo user videos, Whitehouse podcasts, and Google Plus pages in the same issue. Also, make sure that you don't post bug reports alongside feature requests. As a rule of thumb, a feature request does not include outputs of youtube-dl that are not immediately related to the feature at hand. Do not post reports of a network error alongside the request for a new video service.
587
588### Is anyone going to need the feature?
589
590Only post features that you (or an incapicated friend you can personally talk to) require. Do not post features because they seem like a good idea. If they are really useful, they will be requested by someone who requires them.
a17c95f5
PH
591
592### Is your question about youtube-dl?
593
594It may sound strange, but some bug reports we receive are completely unrelated to youtube-dl and relate to a different or even the reporter's own application. Please make sure that you are actually using youtube-dl. If you are using a UI for youtube-dl, report the bug to the maintainer of the actual application providing the UI. On the other hand, if your UI for youtube-dl fails in some way you believe is related to youtube-dl, by all means, go ahead and report the bug.
63ef36e8
PH
595
596# COPYRIGHT
597
598youtube-dl is released into the public domain by the copyright holders.
599
600This README file was originally written by Daniel Bolton (<https://github.com/dbbolton>) and is likewise released into the public domain.