]>
jfr.im git - yt-dlp.git/log
Jaime Marquínez Ferrándiz [Sun, 10 Nov 2013 11:28:21 +0000 (12:28 +0100)]
Merge all the subtitles test into a single file
They reuse a base class
Jaime Marquínez Ferrándiz [Sun, 10 Nov 2013 11:09:12 +0000 (12:09 +0100)]
[ted] Return a single info_dict for talks urls
It failed with the --list-subs option
Jaime Marquínez Ferrándiz [Sun, 10 Nov 2013 10:54:18 +0000 (11:54 +0100)]
Merge pull request #1705 from iemejia/master
[ted] support for subtitles
Jaime Marquínez Ferrándiz [Sun, 10 Nov 2013 10:51:52 +0000 (02:51 -0800)]
Merge pull request #1726 from saper/escaped
Fix AssertionError when og property not found
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 18:21:30 +0000 (19:21 +0100)]
Fix the documentation of '--autonumber-size' (#1743)
it's '--auto-number' not '--autonumber'
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 18:07:34 +0000 (19:07 +0100)]
Improve format listing for long format ids
Now arte.tv videos have quite long ids.
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 18:05:19 +0000 (19:05 +0100)]
[arte] Improve the format sorting
Also use the bitrate.
Prefer normal version and sourds/mal version over original version with subtitles.
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 18:01:23 +0000 (19:01 +0100)]
[arte] Make sure the format_id is unique (closes #1739)
Include the bitrate and use the height instead of the quality field.
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 17:16:32 +0000 (18:16 +0100)]
[cnn] Accept www.cnn.com urls (fixes #1740)
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 17:10:11 +0000 (18:10 +0100)]
[brightcove] the format function requires to specify the index in python2.6
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 17:06:09 +0000 (18:06 +0100)]
[soundcloud] Allow to download tracks marked as not 'streamable'
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 20:47:02 +0000 (21:47 +0100)]
[kankan] Fix the video url
It now requires two additional parameters, one is a timestamp we get from the getCdnresource_flv page and the other is a key we have to build.
Jaime Marquínez Ferrándiz [Sat, 9 Nov 2013 15:40:00 +0000 (16:40 +0100)]
Don't recode the video with m3u8 downloads (fixes #1741)
Jaime Marquínez Ferrándiz [Thu, 7 Nov 2013 20:06:48 +0000 (21:06 +0100)]
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter (fixes #1553)
Philipp Hagemeister [Thu, 7 Nov 2013 10:06:34 +0000 (11:06 +0100)]
release 2013.11.07
Jaime Marquínez Ferrándiz [Thu, 7 Nov 2013 07:03:35 +0000 (08:03 +0100)]
Fix the report progress when file_size is unknown (#1731)
The report_progress function will accept eta and percent with None value and will set the message to 'Unknow ETA' or 'Unknown %'.
Otherwise the values must be numbers.
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 22:45:01 +0000 (23:45 +0100)]
[xnxx] Accept urls that start with 'www' (fixes #1734)
Philipp Hagemeister [Wed, 6 Nov 2013 21:11:46 +0000 (22:11 +0100)]
release 2013.11.06.1
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 21:03:00 +0000 (22:03 +0100)]
[brightcove] Support redirected urls from bcove.me (fixes #1732)
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 20:42:33 +0000 (21:42 +0100)]
[youtube:channel] Fix the extraction
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 19:05:28 +0000 (20:05 +0100)]
Add an extractor for eitb.tv (fixes #1608)
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 18:05:41 +0000 (19:05 +0100)]
[brightcove] Extract all the available formats
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 16:37:39 +0000 (17:37 +0100)]
Add an extractor for space.com (fixes #1718)
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 16:25:38 +0000 (17:25 +0100)]
[brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' (fixes #1697)
It seems to be needed when using the htmlFederated page
Jaime Marquínez Ferrándiz [Wed, 6 Nov 2013 15:40:24 +0000 (16:40 +0100)]
[brightcove] Add the extraction of the url from generic
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 18:14:53 +0000 (19:14 +0100)]
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
Philipp Hagemeister [Wed, 6 Nov 2013 13:02:52 +0000 (14:02 +0100)]
release 2013.11.06
Philipp Hagemeister [Wed, 6 Nov 2013 13:02:33 +0000 (14:02 +0100)]
Fix reporting when file size is unkown (Fixes #1731)
Philipp Hagemeister [Wed, 6 Nov 2013 13:01:43 +0000 (14:01 +0100)]
Clean up imports
Marcin Cieślak [Tue, 5 Nov 2013 22:19:29 +0000 (23:19 +0100)]
Fix AssertionError when og property not found
On tvp.pl some webpages contain OpenGraph
metadata and some don't.
If og property is not found, _og_search_description
fails with
WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
youtube_dl.main()
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
_real_main(argv)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
retcode = ydl.download(all_urls)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
videos = self.extract_info(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
ie_result = ie.extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
return self._real_extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
info['description'] = self._og_search_description(webpage)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
return self._og_search_property('description', html, fatal=False, **kargs)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
return unescapeHTML(escaped)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
assert type(s) == type(u'')
AssertionError
The patch allows me to use:
try:
info['description'] = self._og_search_description(webpage)
info['thumbnail'] = self._og_search_thumbnail(webpage)
except RegexNotFoundError:
pass
Ismaël Mejía [Tue, 5 Nov 2013 11:00:13 +0000 (12:00 +0100)]
[ted] fixed error in case of no subtitles present
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
Jaime Marquínez Ferrándiz [Tue, 5 Nov 2013 07:00:46 +0000 (23:00 -0800)]
Merge pull request #1724 from rzhxeo/generic_youtube
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instead of "
rzhxeo [Tue, 5 Nov 2013 01:08:02 +0000 (02:08 +0100)]
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
Jaime Marquínez Ferrándiz [Mon, 4 Nov 2013 21:20:22 +0000 (22:20 +0100)]
[canal2c] Accept more urls (fixes #1723)
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 16:48:12 +0000 (17:48 +0100)]
[teamcoco] Parse the xml file and extract all the formats
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 16:19:51 +0000 (17:19 +0100)]
Merge pull request #1693 from alexvh/teamcoco_fix
[teamcoco] Fix video url extraction for some videos
Philipp Hagemeister [Sun, 3 Nov 2013 14:58:52 +0000 (15:58 +0100)]
[youtube] Add description for YoutubeSearchDateIE (#1710)
Philipp Hagemeister [Sun, 3 Nov 2013 14:56:55 +0000 (15:56 +0100)]
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
Philipp Hagemeister [Sun, 3 Nov 2013 14:50:36 +0000 (15:50 +0100)]
release 2013.11.03
Philipp Hagemeister [Sun, 3 Nov 2013 14:49:59 +0000 (15:49 +0100)]
[viddler] Support non-digit IDs (Fixes #1714)
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 13:17:12 +0000 (05:17 -0800)]
Merge pull request #1698 from rzhxeo/cinemassacre
[CinemassacreIE] Support more embed urls
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 13:03:17 +0000 (14:03 +0100)]
Style fixes for extractors: remove spaces around (,),{ and }
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 13:04:14 +0000 (05:04 -0800)]
Merge pull request #1679 from rzhxeo/mofosex
Add support for http://www.mofosex.com
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 11:28:02 +0000 (03:28 -0800)]
Merge pull request #1677 from rzhxeo/xtube
Add support for http://www.xtube.com
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 11:25:46 +0000 (03:25 -0800)]
Merge pull request #1676 from rzhxeo/extremetube
Add support for http://www.extremetube.com
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 11:14:44 +0000 (12:14 +0100)]
Set the 'extractor_key' field in the info_dict
It's the string returned by the class method 'ie_key', which allows to retrieve the extractor with 'get_info_extractor'
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 11:11:13 +0000 (12:11 +0100)]
Add the 'webpage_url' field to info_dict
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
Jaime Marquínez Ferrándiz [Sun, 3 Nov 2013 10:56:45 +0000 (11:56 +0100)]
Set the extra_info inside YoutubeDL.process_ie_result and set only if the keys are missing
Craig Markwardt [Sun, 3 Nov 2013 02:40:48 +0000 (22:40 -0400)]
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
rzhxeo [Sat, 2 Nov 2013 21:45:48 +0000 (22:45 +0100)]
[XTubeIE] Add description to TEST
rzhxeo [Sat, 2 Nov 2013 21:33:49 +0000 (22:33 +0100)]
[ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction
Jaime Marquínez Ferrándiz [Sat, 2 Nov 2013 21:15:52 +0000 (14:15 -0700)]
Merge pull request #1678 from rzhxeo/keezmovies
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
Jaime Marquínez Ferrándiz [Sat, 2 Nov 2013 20:20:46 +0000 (21:20 +0100)]
[brightcove] Don't set the extension
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
Jaime Marquínez Ferrándiz [Sat, 2 Nov 2013 19:51:09 +0000 (20:51 +0100)]
[exfm] skip tests
The site is down too often.
Jaime Marquínez Ferrándiz [Sat, 2 Nov 2013 19:46:26 +0000 (20:46 +0100)]
[youtube] Remove vevo test
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
Ismaël Mejía [Sat, 2 Nov 2013 18:56:06 +0000 (19:56 +0100)]
Merge remote-tracking branch 'iemejia/master'
Jaime Marquínez Ferrándiz [Sat, 2 Nov 2013 18:50:57 +0000 (19:50 +0100)]
[bambuser] Add an extractor for channels (closes #1702)
Ismaël Mejía [Sat, 2 Nov 2013 18:50:45 +0000 (19:50 +0100)]
Merge branch 'ted_subtitles'
Ismaël Mejía [Sat, 2 Nov 2013 18:48:39 +0000 (19:48 +0100)]
[ted] Added support for subtitle download
Ismaël Mejía [Sat, 2 Nov 2013 17:01:05 +0000 (18:01 +0100)]
[subtitles] refactor to support websites with subtitle information the
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
Jaime Marquínez Ferrándiz [Sat, 2 Nov 2013 18:01:01 +0000 (19:01 +0100)]
Add an extractor for bambuser.com (#1702)
Philipp Hagemeister [Sat, 2 Nov 2013 10:21:36 +0000 (11:21 +0100)]
release 2013.11.02
Philipp Hagemeister [Sat, 2 Nov 2013 10:21:05 +0000 (11:21 +0100)]
[youtube] Encode subtitle track name in request (Fixes #1700)
Jaime Marquínez Ferrándiz [Fri, 1 Nov 2013 21:28:51 +0000 (22:28 +0100)]
Add an extractor for vk.com (closes #1635)
Jaime Marquínez Ferrándiz [Fri, 1 Nov 2013 10:55:35 +0000 (11:55 +0100)]
[metacafe] Fix support for age-restricted videos (fixes #1696)
The 'Content-Type' header must be set for disabling the family filter.
The 'flashversion' cookie is only needed for AnyClip videos.
Added tests for standard metacafe videos and for age-restricted videos.
Also set the 'age_limit' field.
rzhxeo [Fri, 1 Nov 2013 00:24:23 +0000 (01:24 +0100)]
[CinemassacreIE] Support more embed urls
Alex Van't Hof [Thu, 31 Oct 2013 05:57:22 +0000 (01:57 -0400)]
[teamcoco] Fix video url extraction for some videos
Video url extraction failed for some videos,
e.g. http://teamcoco.com/video/old-time-baseball
The url extracted was also occasionally suboptimal quality,
e.g. http://teamcoco.com/video/louis-ck-interview-george-w-bush
Jaime Marquínez Ferrándiz [Thu, 31 Oct 2013 07:07:26 +0000 (08:07 +0100)]
[livestream] fix the extraction of events
It now uses a json dictionary from the webpage.
Jaime Marquínez Ferrándiz [Thu, 31 Oct 2013 06:55:03 +0000 (07:55 +0100)]
Fix the test for dailymotion subtitles
The extractor returns a single info_dict now.
Philipp Hagemeister [Wed, 30 Oct 2013 23:20:49 +0000 (00:20 +0100)]
[dailymotion] Fix support for age-restricted videos (Fixes #1688)
Philipp Hagemeister [Wed, 30 Oct 2013 00:17:20 +0000 (01:17 +0100)]
release 2013.10.30
Philipp Hagemeister [Wed, 30 Oct 2013 00:17:00 +0000 (01:17 +0100)]
Use index in formt string (Fixes vevo test on Python 2.6)
Philipp Hagemeister [Wed, 30 Oct 2013 00:14:17 +0000 (01:14 +0100)]
[vevo] Readd support for SMIL (Fixes #1683)
Philipp Hagemeister [Wed, 30 Oct 2013 00:09:44 +0000 (01:09 +0100)]
Remove superfluous space
Philipp Hagemeister [Wed, 30 Oct 2013 00:09:26 +0000 (01:09 +0100)]
Fix output indenting for --list-formats
Filippo Valsorda [Tue, 29 Oct 2013 20:44:35 +0000 (16:44 -0400)]
Update the Vimeo test vector md5
confirmed that this is indeed the first 10241 (we went off by one with
byte range 0-10240) of the full, playing mp4, so they probably
reencoded or something
Jaime Marquínez Ferrándiz [Tue, 29 Oct 2013 19:58:49 +0000 (20:58 +0100)]
[arte] Download the 'Originalversion' version if it's the only one available (fixes #1682)
Philipp Hagemeister [Tue, 29 Oct 2013 14:10:09 +0000 (15:10 +0100)]
[vevo] Add more format details
Philipp Hagemeister [Tue, 29 Oct 2013 14:09:45 +0000 (15:09 +0100)]
Nicer --list-formats output
Philipp Hagemeister [Tue, 29 Oct 2013 13:00:01 +0000 (14:00 +0100)]
[vevo] Fix timestamp handling
( / 1000 is implicit float division )
Philipp Hagemeister [Tue, 29 Oct 2013 05:48:39 +0000 (06:48 +0100)]
release 2013.10.29
Philipp Hagemeister [Tue, 29 Oct 2013 05:48:18 +0000 (06:48 +0100)]
Merge remote-tracking branch 'origin/master'
Philipp Hagemeister [Tue, 29 Oct 2013 05:45:54 +0000 (06:45 +0100)]
[youtube] Fix login (Fixes #1681)
Filippo Valsorda [Mon, 28 Oct 2013 23:07:16 +0000 (19:07 -0400)]
[tests] a HTTP 503 is a transient issue
Jaime Marquínez Ferrándiz [Mon, 28 Oct 2013 22:37:01 +0000 (23:37 +0100)]
[mtv] Remove the templates from the mediagen url
Philipp Hagemeister [Mon, 28 Oct 2013 22:18:13 +0000 (23:18 +0100)]
Fix YouTubeDL test
Filippo Valsorda [Mon, 28 Oct 2013 22:03:26 +0000 (18:03 -0400)]
[tests] don't fail on network errors
This is suboptimal, but at least this way we will need to look at the logs
only to check for network errors that happen too often, instead of
parsing a ton of lines each time to see if there is some true test failing
Jaime Marquínez Ferrándiz [Mon, 28 Oct 2013 21:02:17 +0000 (22:02 +0100)]
Add an extractor for MySpace (closes #1666)
Jaime Marquínez Ferrándiz [Mon, 28 Oct 2013 21:01:37 +0000 (22:01 +0100)]
tests: build the filename from the info_dict if the 'file' key is missing
It will need to have the 'id' and 'ext' keys to work.
rzhxeo [Mon, 28 Oct 2013 18:23:48 +0000 (19:23 +0100)]
Add support for http://www.xtube.com
rzhxeo [Mon, 28 Oct 2013 17:22:55 +0000 (18:22 +0100)]
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
rzhxeo [Mon, 28 Oct 2013 17:18:58 +0000 (18:18 +0100)]
Add support for http://www.mofosex.com
rzhxeo [Mon, 28 Oct 2013 16:35:01 +0000 (17:35 +0100)]
Add support for http://www.extremetube.com
Jaime Marquínez Ferrándiz [Mon, 28 Oct 2013 15:54:38 +0000 (16:54 +0100)]
setup.py: Make sure the setuptools_available variable is set
Otherwise it would crash if it can't import setuptools.
Philipp Hagemeister [Mon, 28 Oct 2013 15:35:40 +0000 (08:35 -0700)]
Merge pull request #1675 from rzhxeo/fix
Check if description and thumbnail are None to prevent crash
rzhxeo [Mon, 28 Oct 2013 15:28:35 +0000 (16:28 +0100)]
Check if description and thumbnail are None to prevent crash
Philipp Hagemeister [Mon, 28 Oct 2013 10:41:43 +0000 (11:41 +0100)]
Make "requested format not available" expected (#1655)
Philipp Hagemeister [Mon, 28 Oct 2013 10:41:32 +0000 (11:41 +0100)]
mixcloud does not do any format selection
Philipp Hagemeister [Mon, 28 Oct 2013 10:34:21 +0000 (11:34 +0100)]
release 2013.10.28
Philipp Hagemeister [Mon, 28 Oct 2013 10:32:22 +0000 (11:32 +0100)]
[vimeo] Support hash in URL (Fixes #1669)