dca0872056
Move the opener to the YoutubeDL object.
...
This is the first step towards being able to just import youtube_dl and start using it.
Apart from removing global state, this would fix problems like #1805 .
2013-11-22 19:57:52 +01:00
0b63aed8df
[update] do not assign to unused variables
2013-11-22 19:15:36 +01:00
15c3adbb16
Merge branch 'master' of github.com:rg3/youtube-dl
2013-11-22 19:08:33 +01:00
f143a42fe6
[bandcamp] Skip album test
2013-11-22 19:08:25 +01:00
241650c7ff
[vimeo] Fix the extraction of vimeo pro and player.vimeo.com videos
2013-11-22 18:20:31 +01:00
bfe7439a20
release 2013.11.22
2013-11-22 17:46:26 +01:00
cffa6aa107
[bandcamp] Support trackinfo-style songs ( Fixes #1270 )
2013-11-22 17:44:55 +01:00
02e4ebbbad
[streamcloud] Add IE ( Fixes #1801 )
2013-11-22 17:19:22 +01:00
ab009f59ef
[toutv] Fix a typo
2013-11-22 17:18:03 +01:00
0980426559
[bandcamp] add support for albums (reported in #1270 )
2013-11-22 16:05:14 +01:00
a6a173c2fd
utils.shell_quote: Convert the args to unicode strings
...
The youtube test video failed with `UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 34: ordinal not in range(128)`, the problem was with the filenames being encoded.
2013-11-21 14:09:28 +01:00
2bb683c201
release 2013.11.21
2013-11-21 13:59:33 +01:00
64bb5187f5
[soundcloud] Retrieve the file url using the client_id for the iPhone ( fixes #1798 )
...
The desktop's client_id always give the rtmp url, but with the iPhone one it returns the http url if it's available.
2013-11-21 13:16:19 +01:00
9e4f50a8ae
[sztv] skip test, site is undergoing mid-term maintenance
2013-11-20 09:59:03 +01:00
0190eecc00
[nhl] Make NHLVideocenter IE_DESC fit with other descriptions
2013-11-20 09:45:29 +01:00
ca872a4c0b
[spankwire] Fix description search
2013-11-20 09:23:53 +01:00
f2e87ef4fa
[anitube] Skip test (on travis)
2013-11-20 07:46:44 +01:00
0ad97bbc05
[spankwire] fix check for description
2013-11-20 07:45:32 +01:00
c4864091a1
[videopremium] Support new crazy redirect scheme
2013-11-20 07:43:21 +01:00
9a98a466b3
[toutv] really skip test
2013-11-20 07:37:22 +01:00
d323bcb152
release 2013.11.20
2013-11-20 07:25:17 +01:00
da6a795fdb
[escapist] Fix title search
2013-11-20 07:23:23 +01:00
c5edcde21f
[escapist] upper-case URL
2013-11-20 06:56:59 +01:00
15ff3c831e
[escapist] Fix syntax error
2013-11-20 06:55:07 +01:00
100959a6d9
[escapist] Add support for HD format ( Closes #1755 )
2013-11-20 06:52:08 +01:00
0a120f74b2
Credit @diffycat for anitube
2013-11-20 06:36:00 +01:00
8f05351984
[anitube] Minor fixes ( #1776 )
2013-11-20 06:35:02 +01:00
71791f414c
Merge remote-tracking branch 'diffycat/master'
2013-11-20 06:28:13 +01:00
f3682997d7
Clean up unused imports and other minor mistakes
2013-11-20 06:27:48 +01:00
cc13cc0251
[teamcoco] Correct error
2013-11-20 06:25:33 +01:00
86bd5f2ca9
Merge remote-tracking branch 'dz0ny/patch-1'
2013-11-20 06:21:05 +01:00
8694c60000
import json for --dump-json
2013-11-20 06:18:24 +01:00
9d1538182f
Add an option to dump json information
2013-11-20 06:14:57 +01:00
5904088811
Add support for tou.tv ( Fixes #1792 )
2013-11-20 06:13:19 +01:00
69545c2aff
[d8] inherit from CanalplusIE
...
it reuses the same extraction process
2013-11-19 20:44:20 +01:00
495da337ae
Merge pull request #1758 from migbac/master
...
Add support for d8.tv
2013-11-19 20:43:14 +01:00
34b3afc7be
release 2013.11.19
2013-11-19 12:41:01 +01:00
00373a4c5d
Merge pull request #1790 from rg3/console-title
...
Correctly write and restore the console title on the stack (fixes #1782 )
2013-11-18 07:50:10 -08:00
cb7dfeeac4
[youtube] only allow domain name to be upper-case ( #1786 )
2013-11-18 16:42:35 +01:00
efd6c574a2
Correctly write and restore the console title on the stack ( fixes #1782 )
2013-11-18 16:35:41 +01:00
4113e6ab56
[auengine] Do not return unnecessary ext
2013-11-18 14:36:01 +01:00
9a942a4671
release 2013.11.18.1
2013-11-18 13:56:53 +01:00
9906d397a0
[auengine] Simplify
2013-11-18 13:56:45 +01:00
ae8f787141
Remove iPhone from user agent. This breaks a lot of extractors
...
In the future, it might be worth investigating whether we get better content when we claime to be an iPhone.
2013-11-18 13:52:26 +01:00
a81b4d5c8f
release 2013.11.18
2013-11-18 13:30:43 +01:00
887c6acdf2
Support multiple embedded YouTube URLs ( Fixes #1787 )
2013-11-18 13:28:26 +01:00
83aa529330
Support protocol-independent URLs ( #1787 )
2013-11-18 13:18:17 +01:00
96b31b6533
Add iPhone to UA ( #1746 )
2013-11-18 13:05:58 +01:00
fccd377198
Suppor embed-only videos ( Fixes #1746 )
2013-11-18 13:05:18 +01:00
2b35c9ef74
Merge branch 'master' into rtmpdump
...
Conflicts:
youtube_dl/FileDownloader.py
Merge
2013-11-18 00:27:06 +01:00
73c566695f
release 2013.11.17
2013-11-17 22:14:13 +01:00
63b7b7224a
[MTVIE] Try with RTMP URL if download fails
...
This fixes youtube-dl http://www.southpark.de/clips/155251/cartman-vs-the-dog-whisperer
2013-11-17 22:11:40 +01:00
ce80c8b8ee
Merge pull request #1784 from rzhxeo/southpark
...
Add support for southpark.de
2013-11-17 12:15:13 -08:00
749febf4d1
Allow --console-title when --quiet is given ( Fixes #1783 )
2013-11-17 21:12:50 +01:00
bdde425cbe
Save and restore console title ( Fixes #1782 )
2013-11-17 21:10:11 +01:00
746f491f82
Add support for southpark.de
2013-11-17 17:54:47 +01:00
1672647ade
[SouthParkStudiosIE] Move from _TEST to _TESTS
2013-11-17 17:43:58 +01:00
90b6bbc38c
[SouthParkStudiosIE] Also detect urls without http:// or www
2013-11-17 17:42:24 +01:00
ce02ed60f2
Remove * imports
2013-11-17 16:47:52 +01:00
1e5b9a95fd
Move console_title to YoutubeDL
2013-11-17 11:39:52 +01:00
1d699755e0
[youtube] Add view_count ( Fixes #1781 )
2013-11-17 11:06:16 +01:00
ddf49c6344
[arte] remove two typos
2013-11-17 11:05:49 +01:00
ba3881dffd
Add support for anitube.se ( #1417 )
2013-11-16 18:26:34 +04:00
d1c252048b
[redtube] Do not test md5, seems to vary
2013-11-16 10:30:09 +01:00
eab2724138
[gamekings] Do not test md5 sum, precise file changes regularly
2013-11-16 02:32:23 +01:00
21ea3e06c9
[gamekings] remove unnecessary import
2013-11-16 02:31:02 +01:00
52d703d3d1
[tvp] Skip tests
2013-11-16 02:09:30 +01:00
ce152341a1
[bambuser] Do not test for MD5, seems to be flaky
2013-11-16 01:59:28 +01:00
f058e34011
[dailymotion] Fix playlists
2013-11-16 01:56:23 +01:00
b5349e8721
Fix indentation of (best) and (worst) in --list-formats
2013-11-16 01:39:45 +01:00
7150858d49
[spiegel] Implement format selection
2013-11-16 01:33:12 +01:00
91c7271aab
Add automatic generation of format note based on bitrate and codecs
2013-11-16 01:08:43 +01:00
aa13b2dffd
release 2013.11.15.1
2013-11-15 14:35:00 +01:00
fc2ef392be
[ted] Fix playlists ( Fixes #1770 )
2013-11-15 14:33:51 +01:00
463a908705
[ted] simplify
2013-11-15 14:06:38 +01:00
d24ffe1cfa
[rtlnow] Remove the test for nitro
...
The videos expire.
2013-11-15 12:57:59 +01:00
78fb87b283
Don't accept '>' inside the content attribute in OpenGraph regexes
2013-11-15 12:54:13 +01:00
ab2d524780
Improve the OpenGraph regex
...
* Do not accept '>' between the property and content attributes.
* Recognize the properties if the content attribute is before the property attribute using two regexes (fixes the extraction of the description for SlideshareIE).
2013-11-15 12:24:54 +01:00
85d61685f1
[tvp] Update the title and the description of the test video
2013-11-15 12:10:22 +01:00
b9643eed7c
[youtube:channel] Fix the extraction of autogenerated channels
...
The ajax pages are empty, now it looks directly in the channel's /videos page
2013-11-15 11:51:45 +01:00
feee2ecfa9
Pass the 'download' argument to 'process_video_result' ( fixes #1769 )
2013-11-15 11:04:26 +01:00
a25a5cfeec
release 2013.11.15
2013-11-15 01:47:15 +01:00
0e145dd541
Merge branch 'master' of github.com:rg3/youtube-dl
2013-11-15 01:46:50 +01:00
9f9be844fc
[youtube] Fix protocol-independent URLs ( Fixes #1768 )
2013-11-15 01:45:39 +01:00
e3b9ab5e18
[soundlcoud] Set the correct extension for the tracks ( fixes #1766 )
...
Some tracks are not in mp3 format, they can be wav files.
2013-11-14 19:45:39 +01:00
c66d2baa9c
[livestream] Add an extractor for the original version of livestream ( closes #1764 )
...
The two versions use different systems.
2013-11-14 13:16:32 +01:00
9771cceb2c
Fix filename extension leaking to json filename
...
Makes writeinfojson behaving exactly as writethumbnail in case where filename contains mediafile extension.
Case:
video.mp4 converted to music.mp3 would yield music.mp4.info.json instead music.mp3.info.json or music.info.json
2013-11-13 18:34:03 +01:00
ca715127a2
Don't assume the 'subtitlesformat' is set in the params dict ( fixes #1750 )
2013-11-13 17:14:10 +01:00
ea7a7af1d4
[gamekings] Fix the test video checksum
2013-11-13 17:13:06 +01:00
880e1c529d
[youtube:playlist] Login into youtube if requested ( fixes #1757 )
...
Allows to download private playlists
2013-11-13 16:39:11 +01:00
dcbb45803f
[youtube:playlist] Don't use the gdata api ( closes #1508 )
...
Parse the playlist pages instead
2013-11-13 16:26:50 +01:00
80b9bbce86
release 2013.11.13
2013-11-13 11:09:04 +01:00
d37936386f
Credit @saper for tvp IE ( #1730 )
2013-11-13 11:08:07 +01:00
c3a3028f9f
[tvp] Minor improvements ( #1730 )
2013-11-13 11:06:53 +01:00
6c5ad80cdc
Merge remote-tracking branch 'saper/tvp'
2013-11-13 11:03:49 +01:00
b5bdc2699a
Credit @jelly for gamekings extractor ( #1759 )
2013-11-13 10:52:22 +01:00
384b98cd8f
[gamekings] Minor fixes ( #1759 )
2013-11-13 10:51:00 +01:00
eb9b5bffef
Add extractor for gamekings.tv
2013-11-13 10:38:47 +01:00
0bd59f3723
Add support for d8.tv
2013-11-12 23:32:03 +01:00
8b8cbd8f6d
[vine] Fix uploader extraction
2013-11-12 20:50:52 +01:00
72b18c5d34
FFmpegMetadataPP: don't enclose the values with " ( fixes #1756 )
2013-11-12 20:38:13 +01:00
eb0a839866
[common] Simplify og_search_property
2013-11-12 10:36:23 +01:00
1777d5a952
release 2013.11.11
2013-11-11 18:28:17 +01:00
d4b7da84c3
Clarify -c. Do not pass it in if you don't know what you're doing
...
Suggested in #1743
2013-11-11 14:21:14 +01:00
801dbbdffd
Use avconv for downloading with m3u8 manifests if it's available ( fixes #1735 )
2013-11-10 16:47:03 +01:00
0ed05a1d2d
Use the 'rtmp_live' field for the live parameter of rtmpdump
2013-11-10 12:45:17 +01:00
1008bebade
Merge remote-tracking branch 'rzhxeo/rtmpdump_live'
2013-11-10 12:38:40 +01:00
be6dfd1b49
[ted] Return a single info_dict for talks urls
...
It failed with the --list-subs option
2013-11-10 12:09:12 +01:00
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
fb53d58dcf
Merge pull request #1726 from saper/escaped
...
Fix AssertionError when og property not found
2013-11-10 02:51:52 -08:00
2a9e9b210b
Fix the documentation of '--autonumber-size' ( #1743 )
...
it's '--auto-number' not '--autonumber'
2013-11-09 19:21:30 +01:00
897d6cc43a
Improve format listing for long format ids
...
Now arte.tv videos have quite long ids.
2013-11-09 19:07:34 +01:00
f470c6c812
[arte] Improve the format sorting
...
Also use the bitrate.
Prefer normal version and sourds/mal version over original version with subtitles.
2013-11-09 19:05:19 +01:00
566d4e0425
[arte] Make sure the format_id is unique ( closes #1739 )
...
Include the bitrate and use the height instead of the quality field.
2013-11-09 19:01:23 +01:00
81be02d2f9
[cnn] Accept www.cnn.com urls ( fixes #1740 )
2013-11-09 18:16:32 +01:00
c2b6a482d5
[brightcove] the format function requires to specify the index in python2.6
2013-11-09 18:10:11 +01:00
12c167c881
[soundcloud] Allow to download tracks marked as not 'streamable'
...
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
2013-11-09 18:08:03 +01:00
20aafee7fa
[kankan] Fix the video url
...
It now requires two additional parameters, one is a timestamp we get from the getCdnresource_flv page and the other is a key we have to build.
2013-11-09 16:51:11 +01:00
be07375b66
Don't recode the video with m3u8 downloads ( fixes #1741 )
2013-11-09 16:40:00 +01:00
4894fe8c5b
Report download progress of rtmpdump
2013-11-09 11:14:40 +01:00
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
2013-11-07 21:06:48 +01:00
6161d17579
release 2013.11.07
2013-11-07 11:06:34 +01:00
4ac5306ae7
Fix the report progress when file_size is unknown ( #1731 )
...
The report_progress function will accept eta and percent with None value and will set the message to 'Unknow ETA' or 'Unknown %'.
Otherwise the values must be numbers.
2013-11-07 08:03:35 +01:00
b1a80ec1a9
[xnxx] Accept urls that start with 'www' ( fixes #1734 )
2013-11-06 23:45:01 +01:00
672fe94dcb
release 2013.11.06.1
2013-11-06 22:11:46 +01:00
51040b72ed
[brightcove] Support redirected urls from bcove.me ( fixes #1732 )
...
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
2013-11-06 22:03:00 +01:00
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
5d7b253ea0
Add an extractor for eitb.tv ( fixes #1608 )
...
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
2013-11-06 20:06:14 +01:00
b0759f0c19
[brightcove] Extract all the available formats
2013-11-06 19:05:41 +01:00
065472936a
Add an extractor for space.com ( fixes #1718 )
...
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
2013-11-06 17:37:39 +01:00
fc4a0c2aec
[brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' ( fixes #1697 )
...
It seems to be needed when using the htmlFederated page
2013-11-06 17:31:47 +01:00
eeb165e674
[brightcove] Add the extraction of the url from generic
2013-11-06 16:58:03 +01:00
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
2013-11-06 16:43:26 +01:00
da54be877a
release 2013.11.06
2013-11-06 14:02:52 +01:00
50a886b7ab
Fix reporting when file size is unkown ( Fixes #1731 )
2013-11-06 14:02:33 +01:00
76e67c2cb6
Clean up imports
2013-11-06 14:01:43 +01:00
5137ebac0b
[tvp] Telewizja Polska: new extractor for tvp.pl, fixes #1719
...
Thanks-To: mplonski
https://github.com/mplonski/linux/blob/master/tvp-dl.py
2013-11-05 23:47:40 +01:00
a8eeb0597b
Fix AssertionError when og property not found
...
On tvp.pl some webpages contain OpenGraph
metadata and some don't.
If og property is not found, _og_search_description
fails with
WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
youtube_dl.main()
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
_real_main(argv)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
retcode = ydl.download(all_urls)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
videos = self.extract_info(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
ie_result = ie.extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
return self._real_extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
info['description'] = self._og_search_description(webpage)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
return self._og_search_property('description', html, fatal=False, **kargs)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
return unescapeHTML(escaped)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
assert type(s) == type(u'')
AssertionError
The patch allows me to use:
try:
info['description'] = self._og_search_description(webpage)
info['thumbnail'] = self._og_search_thumbnail(webpage)
except RegexNotFoundError:
pass
2013-11-05 23:19:29 +01:00
4ed3e51080
[ted] fixed error in case of no subtitles present
...
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
2013-11-05 12:00:13 +01:00
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
2013-11-05 02:08:02 +01:00
19b0668251
[canal2c] Accept more urls ( fixes #1723 )
...
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
2013-11-04 22:26:19 +01:00
e7e6b54d8a
[teamcoco] Parse the xml file and extract all the formats
2013-11-03 17:48:12 +01:00
2a1a8ffe41
Merge pull request #1693 from alexvh/teamcoco_fix
...
[teamcoco] Fix video url extraction for some videos
2013-11-03 17:19:51 +01:00
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
2013-11-03 15:59:10 +01:00
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
165e179764
release 2013.11.03
2013-11-03 15:50:36 +01:00
12ebdd1506
[viddler] Support non-digit IDs ( Fixes #1714 )
2013-11-03 15:49:59 +01:00
1baf9a5938
Merge pull request #1698 from rzhxeo/cinemassacre
...
[CinemassacreIE] Support more embed urls
2013-11-03 05:17:12 -08:00
a56f9de156
Style fixes for extractors: remove spaces around (,),{ and }
2013-11-03 14:06:47 +01:00
fa5d47af4b
Merge pull request #1679 from rzhxeo/mofosex
...
Add support for http://www.mofosex.com
2013-11-03 05:04:14 -08:00
Philipp Hagemeister
Jaime Marquínez Ferrándiz
Mohamedh Fazal
rzhxeo
Anton Larionov
Janez Troha
Jelle van der Waa
migbac
Marcin Cieślak
Ismaël Mejía