]> jfr.im git - yt-dlp.git/blame - README.md
[youtube] Add test case for #4431
[yt-dlp.git] / README.md
CommitLineData
94eb2dd1 1youtube-dl - download videos from youtube.com or other video platforms
6bcd846b 2
cfcec693
FV
3# SYNOPSIS
4**youtube-dl** [OPTIONS] URL [URL...]
5
d19bb9c0
PH
6# INSTALLATION
7
8To install it right away for all UNIX users (Linux, OS X, etc.), type:
9
10 sudo curl https://yt-dl.org/latest/youtube-dl -o /usr/local/bin/youtube-dl
11 sudo chmod a+x /usr/local/bin/youtube-dl
12
13If you do not have curl, you can alternatively use a recent wget:
14
6e74521d 15 sudo wget https://yt-dl.org/downloads/latest/youtube-dl -O /usr/local/bin/youtube-dl
d19bb9c0
PH
16 sudo chmod a+x /usr/local/bin/youtube-dl
17
18Windows users can [download a .exe file](https://yt-dl.org/latest/youtube-dl.exe) and place it in their home directory or any other location on their [PATH](http://en.wikipedia.org/wiki/PATH_%28variable%29).
19
3b95347b
PH
20OS X users can install **youtube-dl** with [Homebrew](http://brew.sh/).
21
22 brew install youtube-dl
23
24You can also use pip:
25
26 sudo pip install youtube-dl
27
d19bb9c0
PH
28Alternatively, refer to the developer instructions below for how to check out and work with the git repository. For further options, including PGP signatures, see https://rg3.github.io/youtube-dl/download.html .
29
cfcec693 30# DESCRIPTION
6bcd846b
DB
31**youtube-dl** is a small command-line program to download videos from
32YouTube.com and a few more sites. It requires the Python interpreter, version
a03aaaed 332.6, 2.7, or 3.2+, and it is not platform specific. It should work on
280d6789 34your Unix box, on Windows or on Mac OS X. It is released to the public domain,
6bcd846b
DB
35which means you can modify it, redistribute it or use it however you like.
36
cfcec693 37# OPTIONS
780083db
PH
38 -h, --help print this help text and exit
39 --version print program version and exit
40 -U, --update update this program to latest version. Make
41 sure that you have sufficient permissions
42 (run with sudo if needed)
43 -i, --ignore-errors continue on download errors, for example to
98c4b8fa 44 skip unavailable videos in a playlist
780083db
PH
45 --abort-on-error Abort downloading of further videos (in the
46 playlist or the command line) if an error
47 occurs
48 --dump-user-agent display the current browser identification
780083db
PH
49 --list-extractors List all supported extractors and the URLs
50 they would handle
51 --extractor-descriptions Output descriptions of all supported
52 extractors
53 --proxy URL Use the specified HTTP/HTTPS proxy. Pass in
54 an empty string (--proxy "") for direct
55 connection
780083db 56 --socket-timeout None Time to wait before giving up, in seconds
780083db
PH
57 --default-search PREFIX Use this prefix for unqualified URLs. For
58 example "gvsearch2:" downloads two videos
59 from google videos for youtube-dl "large
f4d66a99 60 apple". Use the value "auto" to let
4f31d0f2
PH
61 youtube-dl guess ("auto_warning" to emit a
62 warning when guessing). "error" just throws
63 an error. The default value "fixup_error"
64 repairs broken URLs, but emits an error if
65 this is not possible instead of searching.
9d3ac744
PH
66 --ignore-config Do not read configuration files. When given
67 in the global configuration file /etc
9776bc7f
PH
68 /youtube-dl.conf: Do not read the user
69 configuration in ~/.config/youtube-
70 dl/config (%APPDATA%/youtube-dl/config.txt
71 on Windows)
36f1c904
PH
72 --flat-playlist Do not extract the videos of a playlist,
73 only list them.
08c1d0d3 74
cfcec693 75## Video Selection:
780083db
PH
76 --playlist-start NUMBER playlist video to start at (default is 1)
77 --playlist-end NUMBER playlist video to end at (default is last)
78 --match-title REGEX download only matching titles (regex or
79 caseless sub-string)
80 --reject-title REGEX skip download for matching titles (regex or
81 caseless sub-string)
82 --max-downloads NUMBER Abort after downloading NUMBER files
83 --min-filesize SIZE Do not download any videos smaller than
84 SIZE (e.g. 50k or 44.6m)
85 --max-filesize SIZE Do not download any videos larger than SIZE
86 (e.g. 50k or 44.6m)
87 --date DATE download only videos uploaded in this date
88 --datebefore DATE download only videos uploaded on or before
89 this date (i.e. inclusive)
90 --dateafter DATE download only videos uploaded on or after
91 this date (i.e. inclusive)
92 --min-views COUNT Do not download any videos with less than
93 COUNT views
94 --max-views COUNT Do not download any videos with more than
95 COUNT views
acda92f6
PH
96 --no-playlist If the URL refers to a video and a
97 playlist, download only the video.
780083db
PH
98 --age-limit YEARS download only videos suitable for the given
99 age
100 --download-archive FILE Download only videos not listed in the
101 archive file. Record the IDs of all
102 downloaded videos in it.
103 --include-ads Download advertisements as well
104 (experimental)
6bcd846b 105
d5a62e4f 106## Download Options:
780083db
PH
107 -r, --rate-limit LIMIT maximum download rate in bytes per second
108 (e.g. 50K or 4.2M)
109 -R, --retries RETRIES number of retries (default is 10)
110 --buffer-size SIZE size of download buffer (e.g. 1024 or 16K)
111 (default is 1024)
112 --no-resize-buffer do not automatically adjust the buffer
113 size. By default, the buffer size is
114 automatically resized from an initial value
115 of SIZE.
d5a62e4f 116
cfcec693 117## Filesystem Options:
36f35428
PH
118 -a, --batch-file FILE file containing URLs to download ('-' for
119 stdin)
780083db 120 --id use only video ID in file name
780083db
PH
121 -A, --auto-number number downloaded files starting from 00000
122 -o, --output TEMPLATE output filename template. Use %(title)s to
123 get the title, %(uploader)s for the
124 uploader name, %(uploader_id)s for the
125 uploader nickname if different,
126 %(autonumber)s to get an automatically
127 incremented number, %(ext)s for the
128 filename extension, %(format)s for the
129 format description (like "22 - 1280x720" or
130 "HD"), %(format_id)s for the unique id of
131 the format (like Youtube's itags: "137"),
132 %(upload_date)s for the upload date
133 (YYYYMMDD), %(extractor)s for the provider
134 (youtube, metacafe, etc), %(id)s for the
1d4df56d
PH
135 video id, %(playlist_title)s,
136 %(playlist_id)s, or %(playlist)s (=title if
137 present, ID otherwise) for the playlist the
780083db 138 video is in, %(playlist_index)s for the
1d4df56d
PH
139 position in the playlist. %(height)s and
140 %(width)s for the width and height of the
141 video format. %(resolution)s for a textual
d63516e9 142 description of the resolution of the video
1d4df56d
PH
143 format. %% for a literal percent. Use - to
144 output to stdout. Can also be used to
145 download to a different directory, for
146 example with -o '/my/downloads/%(uploader)s
147 /%(title)s-%(id)s.%(ext)s' .
780083db
PH
148 --autonumber-size NUMBER Specifies the number of digits in
149 %(autonumber)s when it is present in output
150 filename template or --auto-number option
151 is given
152 --restrict-filenames Restrict filenames to only ASCII
153 characters, and avoid "&" and spaces in
154 filenames
36f35428
PH
155 -t, --title [deprecated] use title in file name
156 (default)
157 -l, --literal [deprecated] alias of --title
780083db
PH
158 -w, --no-overwrites do not overwrite files
159 -c, --continue force resume of partially downloaded files.
160 By default, youtube-dl will resume
161 downloads if possible.
162 --no-continue do not resume partially downloaded files
163 (restart from beginning)
9b36dcbd
PH
164 --no-part do not use .part files - write directly
165 into output file
780083db
PH
166 --no-mtime do not use the Last-modified header to set
167 the file modification time
168 --write-description write video description to a .description
169 file
170 --write-info-json write video metadata to a .info.json file
171 --write-annotations write video annotations to a .annotation
172 file
173 --write-thumbnail write thumbnail image to disk
36f35428
PH
174 --load-info FILE json file containing the video information
175 (created with the "--write-json" option)
176 --cookies FILE file to read cookies from and dump cookie
177 jar in
178 --cache-dir DIR Location in the filesystem where youtube-dl
179 can store some downloaded information
180 permanently. By default $XDG_CACHE_HOME
181 /youtube-dl or ~/.cache/youtube-dl . At the
182 moment, only YouTube player files (for
183 videos with obfuscated signatures) are
184 cached, but that may change.
185 --no-cache-dir Disable filesystem caching
186 --rm-cache-dir Delete all filesystem cache files
6bcd846b 187
cfcec693 188## Verbosity / Simulation Options:
780083db 189 -q, --quiet activates quiet mode
6c072e7d 190 --no-warnings Ignore warnings
780083db
PH
191 -s, --simulate do not download the video and do not write
192 anything to disk
193 --skip-download do not download the video
194 -g, --get-url simulate, quiet but print URL
195 -e, --get-title simulate, quiet but print title
196 --get-id simulate, quiet but print id
197 --get-thumbnail simulate, quiet but print thumbnail URL
198 --get-description simulate, quiet but print video description
199 --get-duration simulate, quiet but print video length
200 --get-filename simulate, quiet but print output filename
201 --get-format simulate, quiet but print output format
bf30f3bd
PH
202 -j, --dump-json simulate, quiet but print JSON information.
203 See --output for a description of available
204 keys.
724d0318
PH
205 -J, --dump-single-json simulate, quiet but print JSON information
206 for each command-line argument. If the URL
207 refers to a playlist, dump the whole
208 playlist information in a single line.
780083db
PH
209 --newline output progress bar as new lines
210 --no-progress do not print progress bar
211 --console-title display progress in console titlebar
212 -v, --verbose print various debugging information
213 --dump-intermediate-pages print downloaded pages to debug problems
214 (very verbose)
215 --write-pages Write downloaded intermediary pages to
216 files in the current directory to debug
217 problems
218 --print-traffic Display sent and read HTTP traffic
6bcd846b 219
36f35428
PH
220## Workarounds:
221 --encoding ENCODING Force the specified encoding (experimental)
222 --no-check-certificate Suppress HTTPS certificate validation.
223 --prefer-insecure Use an unencrypted connection to retrieve
224 information about the video. (Currently
225 supported only for YouTube)
226 --user-agent UA specify a custom user agent
9b36dcbd 227 --referer URL specify a custom referer, use if the video
36f35428
PH
228 access is restricted to one domain
229 --add-header FIELD:VALUE specify a custom HTTP header and its value,
230 separated by a colon ':'. You can use this
231 option multiple times
4f31d0f2
PH
232 --bidi-workaround Work around terminals that lack
233 bidirectional text support. Requires bidiv
234 or fribidi executable in PATH
36f35428 235
cfcec693 236## Video Format Options:
780083db 237 -f, --format FORMAT video format code, specify the order of
fd78a4d3
PH
238 preference using slashes: -f 22/17/18 . -f
239 mp4 , -f m4a and -f flv are also
240 supported. You can also use the special
241 names "best", "bestvideo", "bestaudio",
242 "worst", "worstvideo" and "worstaudio". By
243 default, youtube-dl will pick the best
244 quality. Use commas to download multiple
1d4df56d
PH
245 audio formats, such as -f
246 136/137/mp4/bestvideo,140/m4a/bestaudio.
247 You can merge the video and audio of two
248 formats into a single file using -f <video-
249 format>+<audio-format> (requires ffmpeg or
250 avconv), for example -f
251 bestvideo+bestaudio.
780083db
PH
252 --all-formats download all available video formats
253 --prefer-free-formats prefer free video formats unless a specific
254 one is requested
255 --max-quality FORMAT highest quality format to download
256 -F, --list-formats list all available formats
9b36dcbd
PH
257 --youtube-skip-dash-manifest Do not download the DASH manifest on
258 YouTube videos
8ae7be3e
PH
259
260## Subtitle Options:
780083db
PH
261 --write-sub write subtitle file
262 --write-auto-sub write automatic subtitle file (youtube
263 only)
264 --all-subs downloads all the available subtitles of
265 the video
266 --list-subs lists all available subtitles for the video
267 --sub-format FORMAT subtitle format (default=srt) ([sbv/vtt]
268 youtube only)
269 --sub-lang LANGS languages of the subtitles to download
270 (optional) separated by commas, use IETF
271 language tags like 'en,pt'
6bcd846b 272
cfcec693 273## Authentication Options:
9b36dcbd 274 -u, --username USERNAME login with this account ID
780083db 275 -p, --password PASSWORD account password
b8313f07 276 -2, --twofactor TWOFACTOR two-factor auth code
780083db
PH
277 -n, --netrc use .netrc authentication data
278 --video-password PASSWORD video password (vimeo, smotri)
6bcd846b 279
cfcec693 280## Post-processing Options:
780083db
PH
281 -x, --extract-audio convert video files to audio-only files
282 (requires ffmpeg or avconv and ffprobe or
283 avprobe)
284 --audio-format FORMAT "best", "aac", "vorbis", "mp3", "m4a",
9b36dcbd 285 "opus", or "wav"; "best" by default
780083db
PH
286 --audio-quality QUALITY ffmpeg/avconv audio quality specification,
287 insert a value between 0 (better) and 9
288 (worse) for VBR or a specific bitrate like
289 128K (default 5)
290 --recode-video FORMAT Encode the video to another format if
291 necessary (currently supported:
09018e19 292 mp4|flv|ogg|webm|mkv)
780083db
PH
293 -k, --keep-video keeps the video file on disk after the
294 post-processing; the video is erased by
295 default
296 --no-post-overwrites do not overwrite post-processed files; the
297 post-processed files are overwritten by
298 default
299 --embed-subs embed subtitles in the video (only for mp4
300 videos)
d0f2ab69 301 --embed-thumbnail embed thumbnail in the audio as cover art
780083db
PH
302 --add-metadata write metadata to the video file
303 --xattrs write metadata to the video file's xattrs
304 (using dublin core and xdg standards)
305 --prefer-avconv Prefer avconv over ffmpeg for running the
306 postprocessors (default)
307 --prefer-ffmpeg Prefer ffmpeg over avconv for running the
308 postprocessors
067e9222
PH
309 --exec CMD Execute a command on the file after
310 downloading, similar to find's -exec
311 syntax. Example: --exec 'adb push {}
312 /sdcard/Music/ && rm {}'
6bcd846b 313
df4bad32
PH
314# CONFIGURATION
315
fe52f9f9 316You can configure youtube-dl by placing default arguments (such as `--extract-audio --no-mtime` to always extract the audio and not copy the mtime) into `/etc/youtube-dl.conf` and/or `~/.config/youtube-dl/config`. On Windows, the configuration file locations are `%APPDATA%\youtube-dl\config.txt` and `C:\Users\<Yourname>\youtube-dl.conf`.
df4bad32 317
02531431
PH
318# OUTPUT TEMPLATE
319
320The `-o` option allows users to indicate a template for the output file names. The basic usage is not to set any template arguments when downloading a single file, like in `youtube-dl -o funny_video.flv "http://some/video"`. However, it may contain special sequences that will be replaced when downloading each video. The special sequences have the format `%(NAME)s`. To clarify, that is a percent symbol followed by a name in parenthesis, followed by a lowercase S. Allowed names are:
321
322 - `id`: The sequence will be replaced by the video identifier.
323 - `url`: The sequence will be replaced by the video URL.
324 - `uploader`: The sequence will be replaced by the nickname of the person who uploaded the video.
325 - `upload_date`: The sequence will be replaced by the upload date in YYYYMMDD format.
326 - `title`: The sequence will be replaced by the video title.
877f4c45
PH
327 - `ext`: The sequence will be replaced by the appropriate extension (like flv or mp4).
328 - `epoch`: The sequence will be replaced by the Unix epoch when creating the file.
329 - `autonumber`: The sequence will be replaced by a five-digit number that will be increased with each download, starting at zero.
7eab8dc7 330 - `playlist`: The name or the id of the playlist that contains the video.
d281274b 331 - `playlist_index`: The index of the video in the playlist, a five-digit number.
02531431 332
1083705f 333The current default template is `%(title)s-%(id)s.%(ext)s`.
02531431
PH
334
335In some cases, you don't want special characters such as 中, spaces, or &, such as when transferring the downloaded filename to a Windows system or the filename through an 8bit-unsafe channel. In these cases, add the `--restrict-filenames` flag to get a shorter title:
336
1ce464ab
EJ
337```bash
338$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc
339youtube-dl test video ''_ä↭𝕐.mp4 # All kinds of weird characters
340$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc --restrict-filenames
341youtube-dl_test_video_.mp4 # A simple file name
342```
02531431 343
e31852ab
JMF
344# VIDEO SELECTION
345
346Videos can be filtered by their upload date using the options `--date`, `--datebefore` or `--dateafter`, they accept dates in two formats:
347
348 - Absolute dates: Dates in the format `YYYYMMDD`.
349 - Relative dates: Dates in the format `(now|today)[+-][0-9](day|week|month|year)(s)?`
350
351Examples:
352
1ce464ab
EJ
353```bash
354# Download only the videos uploaded in the last 6 months
355$ youtube-dl --dateafter now-6months
09c4d509 356
1ce464ab
EJ
357# Download only the videos uploaded on January 1, 1970
358$ youtube-dl --date 19700101
09c4d509 359
1ce464ab
EJ
360$ # will only download the videos uploaded in the 200x decade
361$ youtube-dl --dateafter 20000101 --datebefore 20091231
362```
e31852ab 363
cfcec693 364# FAQ
447b1d71 365
89294b5f 366### How do I update youtube-dl?
573585c2 367
89294b5f
PH
368If you've followed [our manual installation instructions](http://rg3.github.io/youtube-dl/download.html), you can simply run `youtube-dl -U` (or, on Linux, `sudo youtube-dl -U`).
369
370If you have used pip, a simple `sudo pip install -U youtube-dl` is sufficient to update.
573585c2 371
89294b5f 372If you have installed youtube-dl using a package manager like *apt-get* or *yum*, use the standard system update mechanism to update. Note that distribution packages are often outdated. As a rule of thumb, youtube-dl releases at least once a month, and often weekly or even daily. Simply go to http://yt-dl.org/ to find out the current version. Unfortunately, there is nothing we youtube-dl developers can do if your distributions serves a really outdated version. You can (and should) complain to your distribution in their bugtracker or support forum.
573585c2 373
89294b5f
PH
374As a last resort, you can also uninstall the version installed by your package manager and follow our manual installation instructions. For that, remove the distribution's package, with a line like
375
376 sudo apt-get remove -y youtube-dl
377
378Afterwards, simply follow [our manual installation instructions](http://rg3.github.io/youtube-dl/download.html):
573585c2
PH
379
380```
573585c2
PH
381sudo wget https://yt-dl.org/latest/youtube-dl -O /usr/local/bin/youtube-dl
382sudo chmod a+x /usr/local/bin/youtube-dl
383hash -r
384```
385
89294b5f
PH
386Again, from then on you'll be able to update with `sudo youtube-dl -U`.
387
388### I'm getting an error `Unable to extract OpenGraph title` on YouTube playlists
389
390YouTube changed their playlist format in March 2014 and later on, so you'll need at least youtube-dl 2014.07.25 to download all YouTube videos.
391
08965906 392If you have installed youtube-dl with a package manager, pip, setup.py or a tarball, please use that to update. Note that Ubuntu packages do not seem to get updated anymore. Since we are not affiliated with Ubuntu, there is little we can do. Feel free to [report bugs](https://bugs.launchpad.net/ubuntu/+source/youtube-dl/+filebug) to the [Ubuntu packaging guys](mailto:ubuntu-motu@lists.ubuntu.com?subject=outdated%20version%20of%20youtube-dl) - all they have to do is update the package to a somewhat recent version. See above for a way to update.
89294b5f 393
573585c2
PH
394### Do I always have to pass in `--max-quality FORMAT`, or `-citw`?
395
396By default, youtube-dl intends to have the best options (incidentally, if you have a convincing case that these should be different, [please file an issue where you explain that](https://yt-dl.org/bug)). Therefore, it is unnecessary and sometimes harmful to copy long option strings from webpages. In particular, `--max-quality` *limits* the video quality (so if you want the best quality, do NOT pass it in), and the only option out of `-citw` that is regularly useful is `-i`.
397
447b1d71
PH
398### Can you please put the -b option back?
399
2e1b3afe 400Most people asking this question are not aware that youtube-dl now defaults to downloading the highest available quality as reported by YouTube, which will be 1080p or 720p in some cases, so you no longer need the `-b` option. For some specific videos, maybe YouTube does not report them to be available in a specific high quality format you're interested in. In that case, simply request it with the `-f` option and youtube-dl will try to download it.
447b1d71 401
f2a3a352 402### I get HTTP error 402 when trying to download a video. What's this?
447b1d71 403
2e1b3afe 404Apparently YouTube requires you to pass a CAPTCHA test if you download too much. We're [considering to provide a way to let you solve the CAPTCHA](https://github.com/rg3/youtube-dl/issues/154), but at the moment, your best course of action is pointing a webbrowser to the youtube URL, solving the CAPTCHA, and restart youtube-dl.
447b1d71
PH
405
406### I have downloaded a video but how can I play it?
407
408Once the video is fully downloaded, use any video player, such as [vlc](http://www.videolan.org) or [mplayer](http://www.mplayerhq.hu/).
409
410### The links provided by youtube-dl -g are not working anymore
411
a0432a1e 412The URLs youtube-dl outputs require the downloader to have the correct cookies. Use the `--cookies` option to write the required cookies into a file, and advise your downloader to read cookies from that file. Some sites also require a common user agent to be used, use `--dump-user-agent` to see the one in use by youtube-dl.
447b1d71 413
454d6691
PH
414### ERROR: no fmt_url_map or conn information found in video info
415
5a2ba45e 416youtube has switched to a new video info format in July 2011 which is not supported by old versions of youtube-dl. You can update youtube-dl with `sudo youtube-dl --update`.
454d6691 417
6c5b442a
PH
418### ERROR: unable to download video ###
419
420youtube requires an additional signature since September 2012 which is not supported by old versions of youtube-dl. You can update youtube-dl with `sudo youtube-dl --update`.
421
5cdfaeb3 422### SyntaxError: Non-ASCII character ###
6c5b442a
PH
423
424The error
425
426 File "youtube-dl", line 2
427 SyntaxError: Non-ASCII character '\x93' ...
428
429means you're using an outdated version of Python. Please update to Python 2.6 or 2.7.
430
5cdfaeb3
FV
431### What is this binary file? Where has the code gone?
432
71f36332 433Since June 2012 (#342) youtube-dl is packed as an executable zipfile, simply unzip it (might need renaming to `youtube-dl.zip` first on some systems) or clone the git repository, as laid out above. If you modify the code, you can run it by executing the `__main__.py` file. To recompile the executable, run `make youtube-dl`.
5cdfaeb3 434
ce367443
FV
435### The exe throws a *Runtime error from Visual C++*
436
437To run the exe you need to install first the [Microsoft Visual C++ 2008 Redistributable Package](http://www.microsoft.com/en-us/download/details.aspx?id=29).
438
a96ed916 439# DEVELOPER INSTRUCTIONS
803abae2 440
63ef36e8 441Most users do not need to build youtube-dl and can [download the builds](http://rg3.github.io/youtube-dl/download.html) or get them from their distribution.
803abae2 442
63ef36e8
PH
443To run youtube-dl as a developer, you don't need to build anything either. Simply execute
444
445 python -m youtube_dl
446
447To run the test, simply invoke your favorite test runner, or execute a test file directly; any of the following work:
448
449 python -m unittest discover
450 python test/test_download.py
451 nosetests
452
453If you want to create a build of youtube-dl yourself, you'll need
454
455* python
456* make
457* pandoc
458* zip
459* nosetests
6bcd846b 460
a96ed916
PH
461### Adding support for a new site
462
5fbd672c
PH
463If you want to add support for a new site, you can follow this quick list (assuming your service is called `yourextractor`):
464
4651. [Fork this repository](https://github.com/rg3/youtube-dl/fork)
4662. Check out the source code with `git clone git@github.com:YOUR_GITHUB_USERNAME/youtube-dl.git`
4673. Start a new git branch with `cd youtube-dl; git checkout -b yourextractor`
4684. Start with this simple template and save it to `youtube_dl/extractor/yourextractor.py`:
1ce464ab
EJ
469 ```python
470 # coding: utf-8
471 from __future__ import unicode_literals
472
1ce464ab
EJ
473 from .common import InfoExtractor
474
475
476 class YourExtractorIE(InfoExtractor):
477 _VALID_URL = r'https?://(?:www\.)?yourextractor\.com/watch/(?P<id>[0-9]+)'
478 _TEST = {
479 'url': 'http://yourextractor.com/watch/42',
7f5c0c4a 480 'md5': 'TODO: md5 sum of the first 10241 bytes of the video file (use --test)',
1ce464ab
EJ
481 'info_dict': {
482 'id': '42',
483 'ext': 'mp4',
484 'title': 'Video title goes here',
218f7549 485 'thumbnail': 're:^https?://.*\.jpg$',
1ce464ab
EJ
486 # TODO more properties, either as:
487 # * A value
488 # * MD5 checksum; start the string with md5:
489 # * A regular expression; start the string with re:
490 # * Any Python type (for example int or float)
5fbd672c 491 }
1ce464ab 492 }
5fbd672c 493
1ce464ab 494 def _real_extract(self, url):
4bc77c84 495 video_id = self._match_id(url)
c920d7f0 496 webpage = self._download_webpage(url, video_id)
5fbd672c 497
1ce464ab 498 # TODO more code goes here, for example ...
1ce464ab 499 title = self._html_search_regex(r'<h1>(.*?)</h1>', webpage, 'title')
d1b3e3dd 500
1ce464ab
EJ
501 return {
502 'id': video_id,
503 'title': title,
c3e74731 504 'description': self._og_search_description(webpage),
1ce464ab
EJ
505 # TODO more properties (see youtube_dl/extractor/common.py)
506 }
507 ```
5fbd672c 5085. Add an import in [`youtube_dl/extractor/__init__.py`](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/__init__.py).
ace52c57 5096. Run `python test/test_download.py TestDownload.test_YourExtractor`. This *should fail* at first, but you can continually re-run it until you're done. If you decide to add more than one test, then rename ``_TEST`` to ``_TESTS`` and make it into a list of dictionaries. The tests will be then be named `TestDownload.test_YourExtractor`, `TestDownload.test_YourExtractor_1`, `TestDownload.test_YourExtractor_2`, etc.
5fbd672c
PH
5107. Have a look at [`youtube_dl/common/extractor/common.py`](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/common.py) for possible helper methods and a [detailed description of what your extractor should return](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/common.py#L38). Add tests and code for as many as you want.
5118. If you can, check the code with [pyflakes](https://pypi.python.org/pypi/pyflakes) (a good idea) and [pep8](https://pypi.python.org/pypi/pep8) (optional, ignore E501).
982a58d0 5129. When the tests pass, [add](http://git-scm.com/docs/git-add) the new files and [commit](http://git-scm.com/docs/git-commit) them and [push](http://git-scm.com/docs/git-push) the result, like this:
5fbd672c
PH
513
514 $ git add youtube_dl/extractor/__init__.py
515 $ git add youtube_dl/extractor/yourextractor.py
516 $ git commit -m '[yourextractor] Add new extractor'
517 $ git push origin yourextractor
518
51910. Finally, [create a pull request](https://help.github.com/articles/creating-a-pull-request). We'll then review and merge it.
520
521In any case, thank you very much for your contributions!
a96ed916 522
03df7baa
PH
523# EMBEDDING YOUTUBE-DL
524
525youtube-dl makes the best effort to be a good command-line program, and thus should be callable from any programming language. If you encounter any problems parsing its output, feel free to [create a report](https://github.com/rg3/youtube-dl/issues/new).
526
527From a Python program, you can embed youtube-dl in a more powerful fashion, like this:
528
529 import youtube_dl
530
531 ydl_opts = {}
532 with youtube_dl.YoutubeDL(ydl_opts) as ydl:
533 ydl.download(['http://www.youtube.com/watch?v=BaW_jenozKc'])
534
535Most likely, you'll want to use various options. For a list of what can be done, have a look at [youtube_dl/YoutubeDL.py](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/YoutubeDL.py#L69). For a start, if you want to intercept youtube-dl's output, set a `logger` object.
536
cfcec693 537# BUGS
e133e121 538
2a18bc9a 539Bugs and suggestions should be reported at: <https://github.com/rg3/youtube-dl/issues> . Unless you were prompted so or there is another pertinent reason (e.g. GitHub fails to accept the bug report), please do not send bug reports via personal email.
e133e121 540
2a18bc9a 541Please include the full output of the command when run with `--verbose`. The output (including the first lines) contain important debugging information. Issues without the full output are often not reproducible and therefore do not get solved in short order, if ever.
4b235346
PH
542
543For discussions, join us in the irc channel #youtube-dl on freenode.
2a18bc9a
PH
544
545When you submit a request, please re-read it once to avoid a couple of mistakes (you can and should use this as a checklist):
546
547### Is the description of the issue itself sufficient?
548
549We often get issue reports that we cannot really decipher. While in most cases we eventually get the required information after asking back multiple times, this poses an unnecessary drain on our resources. Many contributors, including myself, are also not native speakers, so we may misread some parts.
550
551So please elaborate on what feature you are requesting, or what bug you want to be fixed. Make sure that it's obvious
552
553- What the problem is
554- How it could be fixed
555- How your proposed solution would look like
556
557If your report is shorter than two lines, it is almost certainly missing some of these, which makes it hard for us to respond to it. We're often too polite to close the issue outright, but the missing info makes misinterpretation likely. As a commiter myself, I often get frustrated by these issues, since the only possible way for me to move forward on them is to ask for clarification over and over.
558
559For bug reports, this means that your report should contain the *complete* output of youtube-dl when called with the -v flag. The error message you get for (most) bugs even says so, but you would not believe how many of our bug reports do not contain this information.
560
3ef79a97 561Site support requests **must contain an example URL**. An example URL is a URL you might want to download, like http://www.youtube.com/watch?v=BaW_jenozKc . There should be an obvious video present. Except under very special circumstances, the main page of a video service (e.g. http://www.youtube.com/ ) is *not* an example URL.
2a18bc9a
PH
562
563### Are you using the latest version?
564
3d97cbbd 565Before reporting any issue, type youtube-dl -U. This should report that you're up-to-date. About 20% of the reports we receive are already fixed, but people are using outdated versions. This goes for feature requests as well.
2a18bc9a
PH
566
567### Is the issue already documented?
568
569Make sure that someone has not already opened the issue you're trying to open. Search at the top of the window or at https://github.com/rg3/youtube-dl/search?type=Issues . If there is an issue, feel free to write something along the lines of "This affects me as well, with version 2015.01.01. Here is some more information on the issue: ...". While some issues may be old, a new post into them often spurs rapid activity.
570
571### Why are existing options not enough?
572
573Before requesting a new feature, please have a quick peek at [the list of supported options](https://github.com/rg3/youtube-dl/blob/master/README.md#synopsis). Many feature requests are for features that actually exist already! Please, absolutely do show off your work in the issue report and detail how the existing similar options do *not* solve your problem.
574
575### Is there enough context in your bug report?
576
577People want to solve problems, and often think they do us a favor by breaking down their larger problems (e.g. wanting to skip already downloaded files) to a specific request (e.g. requesting us to look whether the file exists before downloading the info page). However, what often happens is that they break down the problem into two steps: One simple, and one impossible (or extremely complicated one).
578
579We are then presented with a very complicated request when the original problem could be solved far easier, e.g. by recording the downloaded video IDs in a separate file. To avoid this, you must include the greater context where it is non-obvious. In particular, every feature request that does not consist of adding support for a new site should contain a use case scenario that explains in what situation the missing feature would be useful.
580
581### Does the issue involve one problem, and one problem only?
582
583Some of our users seem to think there is a limit of issues they can or should open. There is no limit of issues they can or should open. While it may seem appealing to be able to dump all your issues into one ticket, that means that someone who solves one of your issues cannot mark the issue as closed. Typically, reporting a bunch of issues leads to the ticket lingering since nobody wants to attack that behemoth, until someone mercifully splits the issue into multiple ones.
584
585In particular, every site support request issue should only pertain to services at one site (generally under a common domain, but always using the same backend technology). Do not request support for vimeo user videos, Whitehouse podcasts, and Google Plus pages in the same issue. Also, make sure that you don't post bug reports alongside feature requests. As a rule of thumb, a feature request does not include outputs of youtube-dl that are not immediately related to the feature at hand. Do not post reports of a network error alongside the request for a new video service.
586
587### Is anyone going to need the feature?
588
589Only post features that you (or an incapicated friend you can personally talk to) require. Do not post features because they seem like a good idea. If they are really useful, they will be requested by someone who requires them.
a17c95f5
PH
590
591### Is your question about youtube-dl?
592
593It may sound strange, but some bug reports we receive are completely unrelated to youtube-dl and relate to a different or even the reporter's own application. Please make sure that you are actually using youtube-dl. If you are using a UI for youtube-dl, report the bug to the maintainer of the actual application providing the UI. On the other hand, if your UI for youtube-dl fails in some way you believe is related to youtube-dl, by all means, go ahead and report the bug.
63ef36e8
PH
594
595# COPYRIGHT
596
597youtube-dl is released into the public domain by the copyright holders.
598
599This README file was originally written by Daniel Bolton (<https://github.com/dbbolton>) and is likewise released into the public domain.