Commit graph

405 commits

Author SHA1 Message Date
Yen Chi Hsuan 54a3a8827b
[__init__] Metadata should be added after conversion
Fixes #5594
2017-03-06 18:09:12 +08:00
Yen Chi Hsuan 92cb5763f4
[ChangeLog] Update after #12357 2017-03-06 18:04:19 +08:00
Sergey M․ 1664702626
release 2017.03.06 2017-03-06 04:04:39 +07:00
Sergey M․ 3f116b189b
[ChangeLog] Actualize 2017-03-06 04:01:21 +07:00
Sergey M․ afa4597618
release 2017.03.05 2017-03-05 02:23:08 +07:00
Sergey M․ 75027364ba
[ChangeLog] Actualize 2017-03-05 02:22:02 +07:00
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
2017-03-04 23:23:18 +08:00
Sergey M․ 250eea6821
release 2017.03.02 2017-03-02 22:33:22 +07:00
Sergey M․ 28d15b73f8
[ChangeLog] Actualize 2017-03-02 22:29:56 +07:00
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
2017-03-02 20:51:24 +08:00
Sergey M․ 1dc24093f8
release 2017.02.28 2017-02-28 23:59:22 +07:00
Sergey M․ 11bae9cdde
[ChangeLog] Actualize 2017-02-28 23:49:24 +07:00
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
2017-02-28 21:41:03 +08:00
Sergey M․ ef48a1175d
release 2017.02.27 2017-02-27 23:26:07 +07:00
Sergey M․ c6184bcf7b
[ChangeLog] Actualize 2017-02-27 23:24:03 +07:00
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
2017-02-27 21:34:33 +08:00
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
2017-02-26 17:24:54 +08:00
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Sergey M․ 204efc8509
release 2017.02.24.1 2017-02-24 21:59:39 +07:00
Sergey M․ 5d3a51e1b9
[ChangeLog] Actualize 2017-02-24 21:57:39 +07:00
Sergey M․ 6b097cff27
release 2017.02.24 2017-02-24 06:09:15 +07:00
Sergey M․ f2f7961820
[ChangeLog] Actualize 2017-02-24 06:07:41 +07:00
Sergey M․ 345b24538b
release 2017.02.22 2017-02-22 23:50:42 +07:00
Sergey M․ 63a29b6118
[ChangeLog] Actualize 2017-02-22 23:45:01 +07:00
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Sergey M․ 8c6c88c7da
release 2017.02.21 2017-02-21 23:48:24 +07:00
Sergey M․ 159aaaa9d0
[ChangeLog] Actualize 2017-02-21 23:46:58 +07:00
Sergey M․ 28e35f5070
release 2017.02.17 2017-02-17 23:59:56 +07:00
Sergey M․ cf3704c132
[ChangeLog] Actualize 2017-02-17 23:48:30 +07:00
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Sergey M․ 2480b056c1
release 2017.02.16 2017-02-16 00:10:04 +07:00
Sergey M․ 3aa25395aa
[ChangeLog] Actualize 2017-02-16 00:08:56 +07:00
Sergey M․ 58a65ba852
release 2017.02.14 2017-02-14 01:09:18 +07:00
Sergey M․ cedf08ff54
[ChangeLog] Actualize 2017-02-14 01:07:35 +07:00
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
2017-02-12 20:53:55 +08:00
Yen Chi Hsuan 8d38dafbbf
ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Sergey M․ 9b92a5917b
release 2017.02.11 2017-02-11 03:24:00 +07:00
Sergey M․ 3e2274c8b7
[ChangeLog] Actualize 2017-02-11 17:08:22 +07:00
Sergey M․ 55d4de2283
release 2017.02.10 2017-02-10 01:27:33 +07:00
Sergey M․ 61ee556aea
[ChangeLog] Actualize 2017-02-10 01:26:00 +07:00
Sergey M․ 013877298d
release 2017.02.07 2017-02-07 02:04:50 +07:00
Sergey M․ c87f95f991
[ChangeLog] Actualize 2017-02-07 01:58:57 +07:00
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
2017-02-05 22:47:04 +08:00
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
2017-02-05 21:41:08 +08:00
Sergey M․ a713a86755
release 2017.02.04.1 2017-02-04 23:26:39 +07:00
Sergey M․ 7bccd5fc8a
[ChangeLog] Actualize 2017-02-04 23:23:38 +07:00
Sergey M․ 3144eccf55
[ChangeLog] Actualize 2017-02-04 23:22:28 +07:00
Sergey M․ 31487eb974
release 2017.02.04 2017-02-04 22:57:48 +07:00
Yen Chi Hsuan daac118bf4
[ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi Hsuan d7f9242e30
[ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
2017-02-03 01:28:24 +08:00
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
2017-02-02 21:51:31 +08:00
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․ 5069594993
release 2017.02.01 2017-02-01 03:20:09 +07:00
Sergey M․ b996b88092
[ChangeLog] Actualize 2017-02-01 23:29:59 +07:00
Yen Chi Hsuan 000f207944
[prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Sergey M․ d7e215b42d
release 2017.01.31 2017-01-31 22:24:45 +07:00
Sergey M․ 3a528ffd89
[ChangeLog] Actualize 2017-01-31 22:22:42 +07:00
Sergey M․ 4d2fdb07c4
release 2017.01.29 2017-01-29 13:21:42 +07:00
Sergey M․ fe323a4800
[ChangeLog] Actualize 2017-01-29 21:21:26 +07:00
Sergey M․ d41ed6d243
release 2017.01.28 2017-01-28 00:33:55 +07:00
Sergey M․ 815d2a36d8
[ChangeLog] Actualize 2017-01-28 00:03:21 +07:00
Sergey M․ 2417d41535
release 2017.01.25 2017-01-25 23:36:03 +07:00
Sergey M․ 2c302cf66b
[ChangeLog] Actualize 2017-01-25 23:33:46 +07:00
Sergey M․ c3a65c3de0
release 2017.01.24 2017-01-24 02:58:37 +07:00
Sergey M․ ee4c091ce5
[ChangeLog] Actualize 2017-01-24 02:56:19 +07:00
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․ 9d5b29c881
release 2017.01.22 2017-01-22 18:59:04 +07:00
Sergey M․ 6c031a35f3
[ChangeLog] Actualize 2017-01-22 18:57:15 +07:00
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
2017-01-20 22:27:13 +08:00
Sergey M․ 1560baacc6
release 2017.01.18 2017-01-18 23:10:00 +07:00
Sergey M․ 460f61fac4
[ChangeLog] Actualize 2017-01-18 23:06:46 +07:00
Sergey M․ c1c2fe2045
release 2017.01.16 2017-01-16 23:44:04 +07:00
Sergey M․ ddd53c392e
[ChangeLog] Actualize 2017-01-16 23:42:04 +07:00
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
2017-01-16 00:06:52 +08:00
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
2017-01-15 22:51:54 +08:00
Sergey M․ 5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Sergey M․ 0b94510cd0
[ChangeLog] Actualize 2017-01-14 07:30:32 +07:00
Sergey M․ 31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․ 2184d44361
[ChangeLog] Actualize 2017-01-10 21:27:17 +07:00
Philipp Hagemeister bfedb2cc5a small fix to Changelog format 2017-01-09 11:26:01 +01:00
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․ e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․ e60166020b
[ChangeLog] Actualize 2017-01-08 20:56:38 +07:00
Yen Chi Hsuan 1219201143
[ChangeLog] Update after #11581
[ci skip]
2017-01-06 01:07:30 +08:00
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․ 7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․ 2b12e34076
[ChangeLog] Actualize 2017-01-05 04:07:32 +07:00
Sergey M․ 2021b650dd
release 2017.01.02 2017-01-02 23:55:04 +07:00
Sergey M․ b890caaf21
[ChangeLog] Actualize 2017-01-02 23:54:29 +07:00
Sergey M․ dc48a35404
release 2016.12.31 2016-12-31 23:58:41 +07:00
Sergey M․ 1ea0b727c4
[ChangeLog] Actualize 2016-12-31 23:53:30 +07:00
Sergey M․ 5e77c0b58e
release 2016.12.22 2016-12-22 22:52:54 +07:00
Remita Amine ab3091feda
[ChangeLog] Actualize 2016-12-22 22:51:51 +07:00
Sergey M․ 90352a8041
release 2016.12.20 2016-12-20 22:39:39 +07:00
Sergey M․ 1f6a79b0af
[ChangeLog] Actualize 2016-12-20 22:37:06 +07:00
Yen Chi Hsuan 8ab7e6c4cc
[kaltura] Improve widget ID extraction (closes #11480) 2016-12-20 18:45:52 +08:00
Sergey M․ f73d7d5074
release 2016.12.18 2016-12-18 19:50:33 +07:00
Sergey M․ 52a1d48d9f
[ChangeLog] Actualize 2016-12-18 19:48:59 +07:00
Sergey M․ 38be3bc568
release 2016.12.15 2016-12-15 21:16:55 +07:00
Sergey M․ d7ef47bffd
[ChangeLog] Actualize 2016-12-15 21:15:45 +07:00
Yen Chi Hsuan 5c32a5be95 [openload] Recognize oload.tv URLs (#10408) 2016-12-15 17:51:26 +08:00
Yen Chi Hsuan 30918999f5
[facebook] Recognize .onion URLs (closes #11443) 2016-12-15 01:04:49 +08:00
Sergey M․ 3c1e9dc4ec
release 2016.12.12 2016-12-12 01:44:50 +07:00
Sergey M․ 62faf9b55e
[ChangeLog] Actualize 2016-12-12 01:41:08 +07:00
Sergey M․ 18ece70c4d
release 2016.12.09 2016-12-09 02:46:18 +07:00
Sergey M․ 9ed3495eae
[ChangeLog] Actualize 2016-12-09 02:41:49 +07:00
Yen Chi Hsuan 6c20a0bb99
[openload] Fix extraction (closes #10408) 2016-12-09 02:15:16 +08:00
Yen Chi Hsuan d17bfe4095
[thisoldhouse] Recognize /tv-episode/ URLs and update _TESTS
Closes #11271
2016-12-01 14:56:52 +08:00
Sergey M․ 73ec479c7d
release 2016.12.01 2016-12-01 00:15:12 +07:00
Sergey M․ f150530f4d
[ChangeLog] Actualize 2016-12-01 00:13:06 +07:00
Sergey M․ 2b380fc299
release 2016.11.27 2016-11-27 20:05:32 +07:00
Sergey M․ 294d4926d7
[ChangeLog] Actualize 2016-11-27 20:04:03 +07:00
Yen Chi Hsuan 44444f0d3b
[cbslocal] Support newyork.cbslocal.com
Closes #11285
2016-11-24 20:32:17 +08:00
Sergey M․ 3b5daf0736
release 2016.11.22 2016-11-22 22:32:16 +07:00
Sergey M․ c8f56741dd
[ChangeLog] Actualize 2016-11-22 22:29:37 +07:00
Yen Chi Hsuan 1d6ae5628f
[amcnetworks] Recognize more BBC America URLs
Closes #11263
2016-11-22 20:40:57 +08:00
Yen Chi Hsuan 303b38fa84
[ChangeLog] Update for #9028 2016-11-20 00:06:44 +08:00
Sergey M․ 08ec95a6db
[ChangeLog] Actualize 2016-11-19 03:10:20 +07:00
Sergey M․ b25459b88a
release 2016.11.18 2016-11-18 00:25:24 +07:00
Sergey M․ 5f75c4a4ad
[ChangeLog] Actualize 2016-11-18 00:19:55 +07:00
Yen Chi Hsuan d76767c90e
[ChangeLog] Update after #11122 landed 2016-11-16 20:47:15 +08:00
Sergey M․ 6b4dfa2819
release 2016.11.14.1 2016-11-14 02:48:15 +07:00
Sergey M․ 9f60134a9d
[ChangeLog] Actualize 2016-11-14 02:46:12 +07:00
Sergey M․ b3d4bd05f9
release 2016.11.14 2016-11-14 02:39:50 +07:00
Sergey M․ dbffd00ba9
[ChangeLog] Actualize 2016-11-14 02:37:21 +07:00
Yen Chi Hsuan 3eaaa8abac [audioboom] Recognize /posts/ URLs (closes #11149) 2016-11-10 14:52:34 +08:00
Sergey M․ db3367f43e
release 2016.11.08.1 2016-11-08 22:30:53 +07:00
Sergey M․ 6590925c27
[ChangeLog] Actualize 2016-11-08 22:29:16 +07:00
Sergey M․ c58e07a7aa
release 2016.11.08 2016-11-08 22:11:21 +07:00
Sergey M․ f700afa24c
[ChangeLog] Actualize 2016-11-08 22:09:03 +07:00
Yen Chi Hsuan 5d47b38cf5 [tmz:article] Fix extraction (closes #11052) 2016-11-08 21:53:41 +08:00
DarkZeros cb882540e8 [mitele] Fix extraction after website redesign (fixes #10824) 2016-11-07 11:13:59 +01:00
Sergey M․ b30e4c2754
release 2016.11.04 2016-11-04 22:07:54 +07:00
Sergey M․ 09ffe34b00
[ChangeLog] Actualize 2016-11-04 21:59:42 +07:00
Sergey M․ cc99a77ac1
[extractor/generic] Add support for ISM manifests 2016-11-02 03:01:13 +07:00
Sergey M․ 8956d6608a
release 2016.11.02 2016-11-02 02:39:36 +07:00
Sergey M․ a18aeee803
[ChangeLog] Actualize 2016-11-02 02:33:17 +07:00
Sergey M․ e70a5e6566
release 2016.10.30 2016-10-30 18:24:49 +07:00
Sergey M․ 3bf55be466
[ChangeLog] Actualize 2016-10-30 18:19:29 +07:00
Yen Chi Hsuan d9ee2e5cf6
[facebook] Remove SWF params so that 1080P are detected
Closes #11073

In the provided link, SWF params give up to 720P, and VideoConfig
gives 1080P for both best and bestvideo. I guess all Facebook videos
supports HTML5 now, so I remove the old detection for SWF params
2016-10-30 18:20:55 +08:00
Yen Chi Hsuan e1a0b3b81c
[imgur] Recognize /r/ URLs (closes #11071) 2016-10-30 17:02:03 +08:00
Yen Chi Hsuan f02700a1fa
[openload] Fix extraction (#10408)
Thanks @TwelveCharzz again for studying openload codes
2016-10-29 18:00:30 +08:00
Yen Chi Hsuan a5a8877f9c
[adultswim] Fix extraction (closes #10979) 2016-10-27 02:16:48 +08:00