]> jfr.im git - yt-dlp.git/blame - README.md
[downloader/common] Do not use classic int division
[yt-dlp.git] / README.md
CommitLineData
94eb2dd1 1youtube-dl - download videos from youtube.com or other video platforms
6bcd846b 2
cfcec693
FV
3# SYNOPSIS
4**youtube-dl** [OPTIONS] URL [URL...]
5
d19bb9c0
PH
6# INSTALLATION
7
8To install it right away for all UNIX users (Linux, OS X, etc.), type:
9
10 sudo curl https://yt-dl.org/latest/youtube-dl -o /usr/local/bin/youtube-dl
11 sudo chmod a+x /usr/local/bin/youtube-dl
12
13If you do not have curl, you can alternatively use a recent wget:
14
6e74521d 15 sudo wget https://yt-dl.org/downloads/latest/youtube-dl -O /usr/local/bin/youtube-dl
d19bb9c0
PH
16 sudo chmod a+x /usr/local/bin/youtube-dl
17
18Windows users can [download a .exe file](https://yt-dl.org/latest/youtube-dl.exe) and place it in their home directory or any other location on their [PATH](http://en.wikipedia.org/wiki/PATH_%28variable%29).
19
3b95347b
PH
20OS X users can install **youtube-dl** with [Homebrew](http://brew.sh/).
21
22 brew install youtube-dl
23
24You can also use pip:
25
26 sudo pip install youtube-dl
27
d19bb9c0
PH
28Alternatively, refer to the developer instructions below for how to check out and work with the git repository. For further options, including PGP signatures, see https://rg3.github.io/youtube-dl/download.html .
29
cfcec693 30# DESCRIPTION
6bcd846b
DB
31**youtube-dl** is a small command-line program to download videos from
32YouTube.com and a few more sites. It requires the Python interpreter, version
a03aaaed 332.6, 2.7, or 3.2+, and it is not platform specific. It should work on
280d6789 34your Unix box, on Windows or on Mac OS X. It is released to the public domain,
6bcd846b
DB
35which means you can modify it, redistribute it or use it however you like.
36
cfcec693 37# OPTIONS
780083db
PH
38 -h, --help print this help text and exit
39 --version print program version and exit
40 -U, --update update this program to latest version. Make
41 sure that you have sufficient permissions
42 (run with sudo if needed)
43 -i, --ignore-errors continue on download errors, for example to
98c4b8fa 44 skip unavailable videos in a playlist
780083db
PH
45 --abort-on-error Abort downloading of further videos (in the
46 playlist or the command line) if an error
47 occurs
48 --dump-user-agent display the current browser identification
780083db
PH
49 --list-extractors List all supported extractors and the URLs
50 they would handle
51 --extractor-descriptions Output descriptions of all supported
52 extractors
53 --proxy URL Use the specified HTTP/HTTPS proxy. Pass in
54 an empty string (--proxy "") for direct
55 connection
780083db 56 --socket-timeout None Time to wait before giving up, in seconds
780083db
PH
57 --default-search PREFIX Use this prefix for unqualified URLs. For
58 example "gvsearch2:" downloads two videos
59 from google videos for youtube-dl "large
f4d66a99 60 apple". Use the value "auto" to let
4f31d0f2
PH
61 youtube-dl guess ("auto_warning" to emit a
62 warning when guessing). "error" just throws
63 an error. The default value "fixup_error"
64 repairs broken URLs, but emits an error if
65 this is not possible instead of searching.
9d3ac744
PH
66 --ignore-config Do not read configuration files. When given
67 in the global configuration file /etc
9776bc7f
PH
68 /youtube-dl.conf: Do not read the user
69 configuration in ~/.config/youtube-
70 dl/config (%APPDATA%/youtube-dl/config.txt
71 on Windows)
36f1c904
PH
72 --flat-playlist Do not extract the videos of a playlist,
73 only list them.
08c1d0d3 74
cfcec693 75## Video Selection:
780083db
PH
76 --playlist-start NUMBER playlist video to start at (default is 1)
77 --playlist-end NUMBER playlist video to end at (default is last)
ff815fe6 78 --playlist-reverse Download playlist videos in reverse order
780083db
PH
79 --match-title REGEX download only matching titles (regex or
80 caseless sub-string)
81 --reject-title REGEX skip download for matching titles (regex or
82 caseless sub-string)
83 --max-downloads NUMBER Abort after downloading NUMBER files
84 --min-filesize SIZE Do not download any videos smaller than
85 SIZE (e.g. 50k or 44.6m)
86 --max-filesize SIZE Do not download any videos larger than SIZE
87 (e.g. 50k or 44.6m)
88 --date DATE download only videos uploaded in this date
89 --datebefore DATE download only videos uploaded on or before
90 this date (i.e. inclusive)
91 --dateafter DATE download only videos uploaded on or after
92 this date (i.e. inclusive)
93 --min-views COUNT Do not download any videos with less than
94 COUNT views
95 --max-views COUNT Do not download any videos with more than
96 COUNT views
acda92f6
PH
97 --no-playlist If the URL refers to a video and a
98 playlist, download only the video.
780083db
PH
99 --age-limit YEARS download only videos suitable for the given
100 age
101 --download-archive FILE Download only videos not listed in the
102 archive file. Record the IDs of all
103 downloaded videos in it.
104 --include-ads Download advertisements as well
105 (experimental)
6bcd846b 106
d5a62e4f 107## Download Options:
780083db
PH
108 -r, --rate-limit LIMIT maximum download rate in bytes per second
109 (e.g. 50K or 4.2M)
110 -R, --retries RETRIES number of retries (default is 10)
111 --buffer-size SIZE size of download buffer (e.g. 1024 or 16K)
112 (default is 1024)
113 --no-resize-buffer do not automatically adjust the buffer
114 size. By default, the buffer size is
115 automatically resized from an initial value
116 of SIZE.
d5a62e4f 117
cfcec693 118## Filesystem Options:
36f35428
PH
119 -a, --batch-file FILE file containing URLs to download ('-' for
120 stdin)
780083db 121 --id use only video ID in file name
780083db
PH
122 -A, --auto-number number downloaded files starting from 00000
123 -o, --output TEMPLATE output filename template. Use %(title)s to
124 get the title, %(uploader)s for the
125 uploader name, %(uploader_id)s for the
126 uploader nickname if different,
127 %(autonumber)s to get an automatically
128 incremented number, %(ext)s for the
129 filename extension, %(format)s for the
130 format description (like "22 - 1280x720" or
131 "HD"), %(format_id)s for the unique id of
132 the format (like Youtube's itags: "137"),
133 %(upload_date)s for the upload date
134 (YYYYMMDD), %(extractor)s for the provider
135 (youtube, metacafe, etc), %(id)s for the
1d4df56d
PH
136 video id, %(playlist_title)s,
137 %(playlist_id)s, or %(playlist)s (=title if
138 present, ID otherwise) for the playlist the
780083db 139 video is in, %(playlist_index)s for the
1d4df56d
PH
140 position in the playlist. %(height)s and
141 %(width)s for the width and height of the
142 video format. %(resolution)s for a textual
d63516e9 143 description of the resolution of the video
1d4df56d
PH
144 format. %% for a literal percent. Use - to
145 output to stdout. Can also be used to
146 download to a different directory, for
147 example with -o '/my/downloads/%(uploader)s
148 /%(title)s-%(id)s.%(ext)s' .
780083db
PH
149 --autonumber-size NUMBER Specifies the number of digits in
150 %(autonumber)s when it is present in output
151 filename template or --auto-number option
152 is given
153 --restrict-filenames Restrict filenames to only ASCII
154 characters, and avoid "&" and spaces in
155 filenames
36f35428
PH
156 -t, --title [deprecated] use title in file name
157 (default)
158 -l, --literal [deprecated] alias of --title
780083db
PH
159 -w, --no-overwrites do not overwrite files
160 -c, --continue force resume of partially downloaded files.
161 By default, youtube-dl will resume
162 downloads if possible.
163 --no-continue do not resume partially downloaded files
164 (restart from beginning)
9b36dcbd
PH
165 --no-part do not use .part files - write directly
166 into output file
780083db
PH
167 --no-mtime do not use the Last-modified header to set
168 the file modification time
169 --write-description write video description to a .description
170 file
171 --write-info-json write video metadata to a .info.json file
172 --write-annotations write video annotations to a .annotation
173 file
174 --write-thumbnail write thumbnail image to disk
36f35428
PH
175 --load-info FILE json file containing the video information
176 (created with the "--write-json" option)
177 --cookies FILE file to read cookies from and dump cookie
178 jar in
179 --cache-dir DIR Location in the filesystem where youtube-dl
180 can store some downloaded information
181 permanently. By default $XDG_CACHE_HOME
182 /youtube-dl or ~/.cache/youtube-dl . At the
183 moment, only YouTube player files (for
184 videos with obfuscated signatures) are
185 cached, but that may change.
186 --no-cache-dir Disable filesystem caching
187 --rm-cache-dir Delete all filesystem cache files
6bcd846b 188
cfcec693 189## Verbosity / Simulation Options:
780083db 190 -q, --quiet activates quiet mode
6c072e7d 191 --no-warnings Ignore warnings
780083db
PH
192 -s, --simulate do not download the video and do not write
193 anything to disk
194 --skip-download do not download the video
195 -g, --get-url simulate, quiet but print URL
196 -e, --get-title simulate, quiet but print title
197 --get-id simulate, quiet but print id
198 --get-thumbnail simulate, quiet but print thumbnail URL
199 --get-description simulate, quiet but print video description
200 --get-duration simulate, quiet but print video length
201 --get-filename simulate, quiet but print output filename
202 --get-format simulate, quiet but print output format
bf30f3bd
PH
203 -j, --dump-json simulate, quiet but print JSON information.
204 See --output for a description of available
205 keys.
724d0318
PH
206 -J, --dump-single-json simulate, quiet but print JSON information
207 for each command-line argument. If the URL
208 refers to a playlist, dump the whole
209 playlist information in a single line.
780083db
PH
210 --newline output progress bar as new lines
211 --no-progress do not print progress bar
212 --console-title display progress in console titlebar
213 -v, --verbose print various debugging information
214 --dump-intermediate-pages print downloaded pages to debug problems
215 (very verbose)
216 --write-pages Write downloaded intermediary pages to
217 files in the current directory to debug
218 problems
219 --print-traffic Display sent and read HTTP traffic
6bcd846b 220
36f35428
PH
221## Workarounds:
222 --encoding ENCODING Force the specified encoding (experimental)
223 --no-check-certificate Suppress HTTPS certificate validation.
224 --prefer-insecure Use an unencrypted connection to retrieve
225 information about the video. (Currently
226 supported only for YouTube)
227 --user-agent UA specify a custom user agent
9b36dcbd 228 --referer URL specify a custom referer, use if the video
36f35428
PH
229 access is restricted to one domain
230 --add-header FIELD:VALUE specify a custom HTTP header and its value,
231 separated by a colon ':'. You can use this
232 option multiple times
4f31d0f2
PH
233 --bidi-workaround Work around terminals that lack
234 bidirectional text support. Requires bidiv
235 or fribidi executable in PATH
36f35428 236
cfcec693 237## Video Format Options:
780083db 238 -f, --format FORMAT video format code, specify the order of
fd78a4d3
PH
239 preference using slashes: -f 22/17/18 . -f
240 mp4 , -f m4a and -f flv are also
241 supported. You can also use the special
242 names "best", "bestvideo", "bestaudio",
243 "worst", "worstvideo" and "worstaudio". By
244 default, youtube-dl will pick the best
245 quality. Use commas to download multiple
1d4df56d
PH
246 audio formats, such as -f
247 136/137/mp4/bestvideo,140/m4a/bestaudio.
248 You can merge the video and audio of two
249 formats into a single file using -f <video-
250 format>+<audio-format> (requires ffmpeg or
251 avconv), for example -f
252 bestvideo+bestaudio.
780083db
PH
253 --all-formats download all available video formats
254 --prefer-free-formats prefer free video formats unless a specific
255 one is requested
256 --max-quality FORMAT highest quality format to download
257 -F, --list-formats list all available formats
9b36dcbd
PH
258 --youtube-skip-dash-manifest Do not download the DASH manifest on
259 YouTube videos
8ae7be3e
PH
260
261## Subtitle Options:
780083db
PH
262 --write-sub write subtitle file
263 --write-auto-sub write automatic subtitle file (youtube
264 only)
265 --all-subs downloads all the available subtitles of
266 the video
267 --list-subs lists all available subtitles for the video
268 --sub-format FORMAT subtitle format (default=srt) ([sbv/vtt]
269 youtube only)
270 --sub-lang LANGS languages of the subtitles to download
271 (optional) separated by commas, use IETF
272 language tags like 'en,pt'
6bcd846b 273
cfcec693 274## Authentication Options:
9b36dcbd 275 -u, --username USERNAME login with this account ID
780083db 276 -p, --password PASSWORD account password
b8313f07 277 -2, --twofactor TWOFACTOR two-factor auth code
780083db
PH
278 -n, --netrc use .netrc authentication data
279 --video-password PASSWORD video password (vimeo, smotri)
6bcd846b 280
cfcec693 281## Post-processing Options:
780083db
PH
282 -x, --extract-audio convert video files to audio-only files
283 (requires ffmpeg or avconv and ffprobe or
284 avprobe)
285 --audio-format FORMAT "best", "aac", "vorbis", "mp3", "m4a",
9b36dcbd 286 "opus", or "wav"; "best" by default
780083db
PH
287 --audio-quality QUALITY ffmpeg/avconv audio quality specification,
288 insert a value between 0 (better) and 9
289 (worse) for VBR or a specific bitrate like
290 128K (default 5)
291 --recode-video FORMAT Encode the video to another format if
292 necessary (currently supported:
09018e19 293 mp4|flv|ogg|webm|mkv)
780083db
PH
294 -k, --keep-video keeps the video file on disk after the
295 post-processing; the video is erased by
296 default
297 --no-post-overwrites do not overwrite post-processed files; the
298 post-processed files are overwritten by
299 default
300 --embed-subs embed subtitles in the video (only for mp4
301 videos)
d0f2ab69 302 --embed-thumbnail embed thumbnail in the audio as cover art
780083db
PH
303 --add-metadata write metadata to the video file
304 --xattrs write metadata to the video file's xattrs
305 (using dublin core and xdg standards)
306 --prefer-avconv Prefer avconv over ffmpeg for running the
307 postprocessors (default)
308 --prefer-ffmpeg Prefer ffmpeg over avconv for running the
309 postprocessors
067e9222
PH
310 --exec CMD Execute a command on the file after
311 downloading, similar to find's -exec
312 syntax. Example: --exec 'adb push {}
313 /sdcard/Music/ && rm {}'
6bcd846b 314
df4bad32
PH
315# CONFIGURATION
316
fe52f9f9 317You can configure youtube-dl by placing default arguments (such as `--extract-audio --no-mtime` to always extract the audio and not copy the mtime) into `/etc/youtube-dl.conf` and/or `~/.config/youtube-dl/config`. On Windows, the configuration file locations are `%APPDATA%\youtube-dl\config.txt` and `C:\Users\<Yourname>\youtube-dl.conf`.
df4bad32 318
02531431
PH
319# OUTPUT TEMPLATE
320
321The `-o` option allows users to indicate a template for the output file names. The basic usage is not to set any template arguments when downloading a single file, like in `youtube-dl -o funny_video.flv "http://some/video"`. However, it may contain special sequences that will be replaced when downloading each video. The special sequences have the format `%(NAME)s`. To clarify, that is a percent symbol followed by a name in parenthesis, followed by a lowercase S. Allowed names are:
322
323 - `id`: The sequence will be replaced by the video identifier.
324 - `url`: The sequence will be replaced by the video URL.
325 - `uploader`: The sequence will be replaced by the nickname of the person who uploaded the video.
326 - `upload_date`: The sequence will be replaced by the upload date in YYYYMMDD format.
327 - `title`: The sequence will be replaced by the video title.
877f4c45
PH
328 - `ext`: The sequence will be replaced by the appropriate extension (like flv or mp4).
329 - `epoch`: The sequence will be replaced by the Unix epoch when creating the file.
330 - `autonumber`: The sequence will be replaced by a five-digit number that will be increased with each download, starting at zero.
7eab8dc7 331 - `playlist`: The name or the id of the playlist that contains the video.
d281274b 332 - `playlist_index`: The index of the video in the playlist, a five-digit number.
02531431 333
1083705f 334The current default template is `%(title)s-%(id)s.%(ext)s`.
02531431
PH
335
336In some cases, you don't want special characters such as 中, spaces, or &, such as when transferring the downloaded filename to a Windows system or the filename through an 8bit-unsafe channel. In these cases, add the `--restrict-filenames` flag to get a shorter title:
337
1ce464ab
EJ
338```bash
339$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc
340youtube-dl test video ''_ä↭𝕐.mp4 # All kinds of weird characters
341$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc --restrict-filenames
342youtube-dl_test_video_.mp4 # A simple file name
343```
02531431 344
e31852ab
JMF
345# VIDEO SELECTION
346
347Videos can be filtered by their upload date using the options `--date`, `--datebefore` or `--dateafter`, they accept dates in two formats:
348
349 - Absolute dates: Dates in the format `YYYYMMDD`.
350 - Relative dates: Dates in the format `(now|today)[+-][0-9](day|week|month|year)(s)?`
351
352Examples:
353
1ce464ab
EJ
354```bash
355# Download only the videos uploaded in the last 6 months
356$ youtube-dl --dateafter now-6months
09c4d509 357
1ce464ab
EJ
358# Download only the videos uploaded on January 1, 1970
359$ youtube-dl --date 19700101
09c4d509 360
1ce464ab
EJ
361$ # will only download the videos uploaded in the 200x decade
362$ youtube-dl --dateafter 20000101 --datebefore 20091231
363```
e31852ab 364
cfcec693 365# FAQ
447b1d71 366
89294b5f 367### How do I update youtube-dl?
573585c2 368
89294b5f
PH
369If you've followed [our manual installation instructions](http://rg3.github.io/youtube-dl/download.html), you can simply run `youtube-dl -U` (or, on Linux, `sudo youtube-dl -U`).
370
371If you have used pip, a simple `sudo pip install -U youtube-dl` is sufficient to update.
573585c2 372
89294b5f 373If you have installed youtube-dl using a package manager like *apt-get* or *yum*, use the standard system update mechanism to update. Note that distribution packages are often outdated. As a rule of thumb, youtube-dl releases at least once a month, and often weekly or even daily. Simply go to http://yt-dl.org/ to find out the current version. Unfortunately, there is nothing we youtube-dl developers can do if your distributions serves a really outdated version. You can (and should) complain to your distribution in their bugtracker or support forum.
573585c2 374
89294b5f
PH
375As a last resort, you can also uninstall the version installed by your package manager and follow our manual installation instructions. For that, remove the distribution's package, with a line like
376
377 sudo apt-get remove -y youtube-dl
378
379Afterwards, simply follow [our manual installation instructions](http://rg3.github.io/youtube-dl/download.html):
573585c2
PH
380
381```
573585c2
PH
382sudo wget https://yt-dl.org/latest/youtube-dl -O /usr/local/bin/youtube-dl
383sudo chmod a+x /usr/local/bin/youtube-dl
384hash -r
385```
386
89294b5f
PH
387Again, from then on you'll be able to update with `sudo youtube-dl -U`.
388
389### I'm getting an error `Unable to extract OpenGraph title` on YouTube playlists
390
391YouTube changed their playlist format in March 2014 and later on, so you'll need at least youtube-dl 2014.07.25 to download all YouTube videos.
392
08965906 393If you have installed youtube-dl with a package manager, pip, setup.py or a tarball, please use that to update. Note that Ubuntu packages do not seem to get updated anymore. Since we are not affiliated with Ubuntu, there is little we can do. Feel free to [report bugs](https://bugs.launchpad.net/ubuntu/+source/youtube-dl/+filebug) to the [Ubuntu packaging guys](mailto:ubuntu-motu@lists.ubuntu.com?subject=outdated%20version%20of%20youtube-dl) - all they have to do is update the package to a somewhat recent version. See above for a way to update.
89294b5f 394
573585c2
PH
395### Do I always have to pass in `--max-quality FORMAT`, or `-citw`?
396
397By default, youtube-dl intends to have the best options (incidentally, if you have a convincing case that these should be different, [please file an issue where you explain that](https://yt-dl.org/bug)). Therefore, it is unnecessary and sometimes harmful to copy long option strings from webpages. In particular, `--max-quality` *limits* the video quality (so if you want the best quality, do NOT pass it in), and the only option out of `-citw` that is regularly useful is `-i`.
398
447b1d71
PH
399### Can you please put the -b option back?
400
2e1b3afe 401Most people asking this question are not aware that youtube-dl now defaults to downloading the highest available quality as reported by YouTube, which will be 1080p or 720p in some cases, so you no longer need the `-b` option. For some specific videos, maybe YouTube does not report them to be available in a specific high quality format you're interested in. In that case, simply request it with the `-f` option and youtube-dl will try to download it.
447b1d71 402
f2a3a352 403### I get HTTP error 402 when trying to download a video. What's this?
447b1d71 404
2e1b3afe 405Apparently YouTube requires you to pass a CAPTCHA test if you download too much. We're [considering to provide a way to let you solve the CAPTCHA](https://github.com/rg3/youtube-dl/issues/154), but at the moment, your best course of action is pointing a webbrowser to the youtube URL, solving the CAPTCHA, and restart youtube-dl.
447b1d71
PH
406
407### I have downloaded a video but how can I play it?
408
409Once the video is fully downloaded, use any video player, such as [vlc](http://www.videolan.org) or [mplayer](http://www.mplayerhq.hu/).
410
411### The links provided by youtube-dl -g are not working anymore
412
a0432a1e 413The URLs youtube-dl outputs require the downloader to have the correct cookies. Use the `--cookies` option to write the required cookies into a file, and advise your downloader to read cookies from that file. Some sites also require a common user agent to be used, use `--dump-user-agent` to see the one in use by youtube-dl.
447b1d71 414
454d6691
PH
415### ERROR: no fmt_url_map or conn information found in video info
416
5a2ba45e 417youtube has switched to a new video info format in July 2011 which is not supported by old versions of youtube-dl. You can update youtube-dl with `sudo youtube-dl --update`.
454d6691 418
6c5b442a
PH
419### ERROR: unable to download video ###
420
421youtube requires an additional signature since September 2012 which is not supported by old versions of youtube-dl. You can update youtube-dl with `sudo youtube-dl --update`.
422
5cdfaeb3 423### SyntaxError: Non-ASCII character ###
6c5b442a
PH
424
425The error
426
427 File "youtube-dl", line 2
428 SyntaxError: Non-ASCII character '\x93' ...
429
430means you're using an outdated version of Python. Please update to Python 2.6 or 2.7.
431
5cdfaeb3
FV
432### What is this binary file? Where has the code gone?
433
71f36332 434Since June 2012 (#342) youtube-dl is packed as an executable zipfile, simply unzip it (might need renaming to `youtube-dl.zip` first on some systems) or clone the git repository, as laid out above. If you modify the code, you can run it by executing the `__main__.py` file. To recompile the executable, run `make youtube-dl`.
5cdfaeb3 435
ce367443
FV
436### The exe throws a *Runtime error from Visual C++*
437
438To run the exe you need to install first the [Microsoft Visual C++ 2008 Redistributable Package](http://www.microsoft.com/en-us/download/details.aspx?id=29).
439
a96ed916 440# DEVELOPER INSTRUCTIONS
803abae2 441
63ef36e8 442Most users do not need to build youtube-dl and can [download the builds](http://rg3.github.io/youtube-dl/download.html) or get them from their distribution.
803abae2 443
63ef36e8
PH
444To run youtube-dl as a developer, you don't need to build anything either. Simply execute
445
446 python -m youtube_dl
447
448To run the test, simply invoke your favorite test runner, or execute a test file directly; any of the following work:
449
450 python -m unittest discover
451 python test/test_download.py
452 nosetests
453
454If you want to create a build of youtube-dl yourself, you'll need
455
456* python
457* make
458* pandoc
459* zip
460* nosetests
6bcd846b 461
a96ed916
PH
462### Adding support for a new site
463
5fbd672c
PH
464If you want to add support for a new site, you can follow this quick list (assuming your service is called `yourextractor`):
465
4661. [Fork this repository](https://github.com/rg3/youtube-dl/fork)
4672. Check out the source code with `git clone git@github.com:YOUR_GITHUB_USERNAME/youtube-dl.git`
4683. Start a new git branch with `cd youtube-dl; git checkout -b yourextractor`
4694. Start with this simple template and save it to `youtube_dl/extractor/yourextractor.py`:
1ce464ab
EJ
470 ```python
471 # coding: utf-8
472 from __future__ import unicode_literals
473
1ce464ab
EJ
474 from .common import InfoExtractor
475
476
477 class YourExtractorIE(InfoExtractor):
478 _VALID_URL = r'https?://(?:www\.)?yourextractor\.com/watch/(?P<id>[0-9]+)'
479 _TEST = {
480 'url': 'http://yourextractor.com/watch/42',
7f5c0c4a 481 'md5': 'TODO: md5 sum of the first 10241 bytes of the video file (use --test)',
1ce464ab
EJ
482 'info_dict': {
483 'id': '42',
484 'ext': 'mp4',
485 'title': 'Video title goes here',
218f7549 486 'thumbnail': 're:^https?://.*\.jpg$',
1ce464ab
EJ
487 # TODO more properties, either as:
488 # * A value
489 # * MD5 checksum; start the string with md5:
490 # * A regular expression; start the string with re:
491 # * Any Python type (for example int or float)
5fbd672c 492 }
1ce464ab 493 }
5fbd672c 494
1ce464ab 495 def _real_extract(self, url):
4bc77c84 496 video_id = self._match_id(url)
c920d7f0 497 webpage = self._download_webpage(url, video_id)
5fbd672c 498
1ce464ab 499 # TODO more code goes here, for example ...
1ce464ab 500 title = self._html_search_regex(r'<h1>(.*?)</h1>', webpage, 'title')
d1b3e3dd 501
1ce464ab
EJ
502 return {
503 'id': video_id,
504 'title': title,
c3e74731 505 'description': self._og_search_description(webpage),
1ce464ab
EJ
506 # TODO more properties (see youtube_dl/extractor/common.py)
507 }
508 ```
5fbd672c 5095. Add an import in [`youtube_dl/extractor/__init__.py`](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/__init__.py).
ace52c57 5106. Run `python test/test_download.py TestDownload.test_YourExtractor`. This *should fail* at first, but you can continually re-run it until you're done. If you decide to add more than one test, then rename ``_TEST`` to ``_TESTS`` and make it into a list of dictionaries. The tests will be then be named `TestDownload.test_YourExtractor`, `TestDownload.test_YourExtractor_1`, `TestDownload.test_YourExtractor_2`, etc.
5fbd672c
PH
5117. Have a look at [`youtube_dl/common/extractor/common.py`](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/common.py) for possible helper methods and a [detailed description of what your extractor should return](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/extractor/common.py#L38). Add tests and code for as many as you want.
5128. If you can, check the code with [pyflakes](https://pypi.python.org/pypi/pyflakes) (a good idea) and [pep8](https://pypi.python.org/pypi/pep8) (optional, ignore E501).
982a58d0 5139. When the tests pass, [add](http://git-scm.com/docs/git-add) the new files and [commit](http://git-scm.com/docs/git-commit) them and [push](http://git-scm.com/docs/git-push) the result, like this:
5fbd672c
PH
514
515 $ git add youtube_dl/extractor/__init__.py
516 $ git add youtube_dl/extractor/yourextractor.py
517 $ git commit -m '[yourextractor] Add new extractor'
518 $ git push origin yourextractor
519
52010. Finally, [create a pull request](https://help.github.com/articles/creating-a-pull-request). We'll then review and merge it.
521
522In any case, thank you very much for your contributions!
a96ed916 523
03df7baa
PH
524# EMBEDDING YOUTUBE-DL
525
526youtube-dl makes the best effort to be a good command-line program, and thus should be callable from any programming language. If you encounter any problems parsing its output, feel free to [create a report](https://github.com/rg3/youtube-dl/issues/new).
527
528From a Python program, you can embed youtube-dl in a more powerful fashion, like this:
529
530 import youtube_dl
531
532 ydl_opts = {}
533 with youtube_dl.YoutubeDL(ydl_opts) as ydl:
534 ydl.download(['http://www.youtube.com/watch?v=BaW_jenozKc'])
535
536Most likely, you'll want to use various options. For a list of what can be done, have a look at [youtube_dl/YoutubeDL.py](https://github.com/rg3/youtube-dl/blob/master/youtube_dl/YoutubeDL.py#L69). For a start, if you want to intercept youtube-dl's output, set a `logger` object.
537
cfcec693 538# BUGS
e133e121 539
b3efb3eb 540Bugs and suggestions should be reported at: <https://github.com/rg3/youtube-dl/issues> . Unless you were prompted so or there is another pertinent reason (e.g. GitHub fails to accept the bug report), please do not send bug reports via personal email. For discussions, join us in the irc channel #youtube-dl on freenode.
e133e121 541
2a18bc9a 542Please include the full output of the command when run with `--verbose`. The output (including the first lines) contain important debugging information. Issues without the full output are often not reproducible and therefore do not get solved in short order, if ever.
4b235346 543
b3efb3eb 544Please re-read your issue once again to avoid a couple of common mistakes (you can and should use this as a checklist):
2a18bc9a
PH
545
546### Is the description of the issue itself sufficient?
547
548We often get issue reports that we cannot really decipher. While in most cases we eventually get the required information after asking back multiple times, this poses an unnecessary drain on our resources. Many contributors, including myself, are also not native speakers, so we may misread some parts.
549
550So please elaborate on what feature you are requesting, or what bug you want to be fixed. Make sure that it's obvious
551
552- What the problem is
553- How it could be fixed
554- How your proposed solution would look like
555
556If your report is shorter than two lines, it is almost certainly missing some of these, which makes it hard for us to respond to it. We're often too polite to close the issue outright, but the missing info makes misinterpretation likely. As a commiter myself, I often get frustrated by these issues, since the only possible way for me to move forward on them is to ask for clarification over and over.
557
558For bug reports, this means that your report should contain the *complete* output of youtube-dl when called with the -v flag. The error message you get for (most) bugs even says so, but you would not believe how many of our bug reports do not contain this information.
559
3ef79a97 560Site support requests **must contain an example URL**. An example URL is a URL you might want to download, like http://www.youtube.com/watch?v=BaW_jenozKc . There should be an obvious video present. Except under very special circumstances, the main page of a video service (e.g. http://www.youtube.com/ ) is *not* an example URL.
2a18bc9a
PH
561
562### Are you using the latest version?
563
3d97cbbd 564Before reporting any issue, type youtube-dl -U. This should report that you're up-to-date. About 20% of the reports we receive are already fixed, but people are using outdated versions. This goes for feature requests as well.
2a18bc9a
PH
565
566### Is the issue already documented?
567
568Make sure that someone has not already opened the issue you're trying to open. Search at the top of the window or at https://github.com/rg3/youtube-dl/search?type=Issues . If there is an issue, feel free to write something along the lines of "This affects me as well, with version 2015.01.01. Here is some more information on the issue: ...". While some issues may be old, a new post into them often spurs rapid activity.
569
570### Why are existing options not enough?
571
572Before requesting a new feature, please have a quick peek at [the list of supported options](https://github.com/rg3/youtube-dl/blob/master/README.md#synopsis). Many feature requests are for features that actually exist already! Please, absolutely do show off your work in the issue report and detail how the existing similar options do *not* solve your problem.
573
574### Is there enough context in your bug report?
575
576People want to solve problems, and often think they do us a favor by breaking down their larger problems (e.g. wanting to skip already downloaded files) to a specific request (e.g. requesting us to look whether the file exists before downloading the info page). However, what often happens is that they break down the problem into two steps: One simple, and one impossible (or extremely complicated one).
577
578We are then presented with a very complicated request when the original problem could be solved far easier, e.g. by recording the downloaded video IDs in a separate file. To avoid this, you must include the greater context where it is non-obvious. In particular, every feature request that does not consist of adding support for a new site should contain a use case scenario that explains in what situation the missing feature would be useful.
579
580### Does the issue involve one problem, and one problem only?
581
582Some of our users seem to think there is a limit of issues they can or should open. There is no limit of issues they can or should open. While it may seem appealing to be able to dump all your issues into one ticket, that means that someone who solves one of your issues cannot mark the issue as closed. Typically, reporting a bunch of issues leads to the ticket lingering since nobody wants to attack that behemoth, until someone mercifully splits the issue into multiple ones.
583
584In particular, every site support request issue should only pertain to services at one site (generally under a common domain, but always using the same backend technology). Do not request support for vimeo user videos, Whitehouse podcasts, and Google Plus pages in the same issue. Also, make sure that you don't post bug reports alongside feature requests. As a rule of thumb, a feature request does not include outputs of youtube-dl that are not immediately related to the feature at hand. Do not post reports of a network error alongside the request for a new video service.
585
586### Is anyone going to need the feature?
587
588Only post features that you (or an incapicated friend you can personally talk to) require. Do not post features because they seem like a good idea. If they are really useful, they will be requested by someone who requires them.
a17c95f5
PH
589
590### Is your question about youtube-dl?
591
592It may sound strange, but some bug reports we receive are completely unrelated to youtube-dl and relate to a different or even the reporter's own application. Please make sure that you are actually using youtube-dl. If you are using a UI for youtube-dl, report the bug to the maintainer of the actual application providing the UI. On the other hand, if your UI for youtube-dl fails in some way you believe is related to youtube-dl, by all means, go ahead and report the bug.
63ef36e8
PH
593
594# COPYRIGHT
595
596youtube-dl is released into the public domain by the copyright holders.
597
598This README file was originally written by Daniel Bolton (<https://github.com/dbbolton>) and is likewise released into the public domain.