[Release] themoviedb.org TV scraper

  Thread Rating:
  • 1 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
olympia Offline
Team-Kodi Member
Posts: 2,697
Joined: May 2008
Reputation: 39
Post: #16
The scraper should be fixed, not deeply tested though.
find quote
PauleFoul Offline
Junior Member
Posts: 18
Joined: Jan 2015
Reputation: 0
Post: #17
Hi,

i named my movies like this:

2014-12 - BD - FSK16 - Left Behind

But this make problems to find the right Movie in the DataBase.

Is it not possible to add an option to the Scarper ADD-ON to ignore the first 23 character (or another number) for putting moviename from filename?
find quote
nickr Offline
Team-Kodi Member
Posts: 17,341
Joined: May 2009
Reputation: 348
Location: Christchurch NZ
Post: #18
This is not about movies. It is about a TV scraper.

If I have helped you or increased your knowledge, click the 'thank user' button to give thanks :) (People with less than 20 posts won't see the "Thank you" button.)
find quote
PauleFoul Offline
Junior Member
Posts: 18
Joined: Jan 2015
Reputation: 0
Post: #19
Sorry i read this wrong...
find quote
kekslieb Offline
Junior Member
Posts: 2
Joined: Mar 2015
Reputation: 0
Post: #20
Hi, maybe there is an issue or i'm just make something wrong. I hope someone can help me.
Yesterday i switched the scraper from tvdb to moviedb and now some episodse has totaly strange names.
As an example: Burn Notice Season 1 (https://www.themoviedb.org/tv/2919-burn-notice/season/1)
Scraper Language: DE (German)
Result in Kodi: http://fs1.directupload.net/images/150326/iadfnvbj.png

Code:
00:03:25 T:8784   DEBUG: ADDON::CScraper::GetVideoDetails: Reading episode 'http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&language=de&append_to_response=credits,external_ids,images&include_image_language=de,en,null' using The Movie Database scraper (file: 'C:\Users\kekslieb\AppData\Roaming\Kodi\addons\metadata.tvshows.themoviedb.org',​ content: 'tvshows', version: '1.0.3')
00:03:25 T:8784   DEBUG: Using proxy localhost:8888, type 0
00:03:25 T:8784   DEBUG: CurlFile::Open(09A55630) http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&language=de&append_to_response=credits,external_ids,images&include_image_language=de,en,null
00:03:25 T:8784   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&language=de&append_to_response=credits,external_ids,images&include_image_language=de,en,null"
00:03:25 T:8784   DEBUG: scraper: GetEpisodeDetails returned <details><url function="ParseFallbackTMDBEpisodeTitle" cache="tmdb-2919-en-episode-s1e2.json">http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&amp;language=en</url><season>1</season><episode>2</episode><aired>2007-07-05</aired><uniqueid>223761</uniqueid><url function="ParseFallbackTMDBPlot" cache="tmdb-2919-en-episode-s1e2.json">http://api.themoviedb.org/3/tv/2919/season/2/episode/1?api_key=57983e31fb435df4df77afb854740ea9&amp;language=en</url><director>Rod Hardy</director><director>Jace Alexander</director><credits>Matt Nix</credits><chain function="GetCast">2919|1|2</chain><chain function="GetEpisodeArt">2919|1|2</chain></details>
00:03:25 T:8784   DEBUG: CurlFile::Open(09A55630) http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&language=en
00:03:25 T:8784   DEBUG: CScraperUrl::Get: Using "UTF-8" charset for "http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&language=en"
00:03:25 T:8784   DEBUG: scraper: ParseFallbackTMDBEpisodeTitle returned <details><title>Mark Pellegrino","credit_id":"525749d119c29531db098ad6","character":"","order":1,"profile_path":"/ozVIcRFFWyceqjJ69N9oHWYGBBG.jpg"}],"name":"Identity</title></details>
00:03:25 T:8784   DEBUG: scraper: ParseFallbackTMDBPlot returned <details><plot>Michael helps Madeline's friend retrieve money from a swindler, and in return he receives information about some visitors that came to his mother's home.</plot></details>
00:03:25 T:8784   DEBUG: scraper: GetCast returned <details><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.themoviedb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url cache="tmdb-2919-de-episode-s1e2.json" function="ParseCast">http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&amp;language=de&amp;append_to_response=credits</url></details>
00:03:25 T:8784   DEBUG: scraper: ParseTMDBBaseImageURL returned <details>http://image.tmdb.org/t/p/</details>
00:03:26 T:8784   DEBUG: scraper: ParseCast returned <details><actor><name>Gabrielle Anwar</name><role>Fiona Glenanne</role><order>0</order><thumb>http://image.tmdb.org/t/p/original/khnEDczzSy6UcbnqZ6Sb4lWxnkE.jpg</thumb></actor><actor><name>Sharon Gless</name><role>Madeline Westen</role><order>1</order><thumb>http://image.tmdb.org/t/p/original/ul7dTg6MxIU72inhxXiMWEJH8MP.jpg</thumb></actor><actor><name>Jeffrey Donovan</name><role>Michael Westen</role><order>2</order><thumb>http://image.tmdb.org/t/p/original/5i47zZDpnAjLBtQdlqhg5AIYCuT.jpg</thumb></actor><actor><name>Bruce Campbell</name><role>Sam Axe</role><order>3</order><thumb>http://image.tmdb.org/t/p/original/ox3Mf0pXGEiWfRO2TYcua0EHUQN.jpg</thumb></actor><actor><name>Lucy Lawless</name><role>Evelyn</role><order>14</order><thumb>http://image.tmdb.org/t/p/original/5A3gJXknAF0rKJAaBbHPr0IqS2q.jpg</thumb></actor><actor><name>Marc Macaulay</name><role>Agent Harris</role><order>17</order><thumb>http://image.tmdb.org/t/p/original/eSNgzHn7NUX9iAbG1MLV41lqy14.jpg</thumb></actor><actor><name>Josh Randall</name><role></role><thumb>http://image.tmdb.org/t/p/original/jUg69xKO9L1HqRPgrSjBunRlkt2.jpg</thumb></actor><actor><name>Mark Pellegrino</name><role></role><thumb>http://image.tmdb.org/t/p/original/ozVIcRFFWyceqjJ69N9oHWYGBBG.jpg</thumb></actor></details>
00:03:26 T:8784   DEBUG: scraper: GetEpisodeArt returned <details><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.themoviedb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url cache="tmdb-2919-de-episode-s1e2.json" function="ParseEpisodeArt">http://api.themoviedb.org/3/tv/2919/season/1/episode/2/images?api_key=57983e31fb435df4df77afb854740ea9&amp;language=de&amp;include_image_language=de,en,null</url></details>
00:03:26 T:8784   DEBUG: scraper: ParseTMDBBaseImageURL returned <details>http://image.tmdb.org/t/p/</details>
00:03:26 T:8784   DEBUG: scraper: ParseEpisodeArt returned <details><thumb>http://image.tmdb.org/t/p/original/xCrSERQLCemCuosWvsClTtyfbwe.jpg</thumb></details>
00:03:26 T:8784   DEBUG: Thread VideoInfoDownloader 8784 terminating
00:03:26 T:5284   DEBUG: VideoInfoScanner: Adding new item to tvshows:smb://samba.foo.bar/serien/Burn.Notice/Staffel.01/Burn.Notice.S01E02.Ausgetrickst.German.720p.HDTV.x264-iND/iND-burnnotice-s01e02-720p.mp4
00:03:26 T:5284   DEBUG: CAnnouncementManager - Announcement: OnUpdate from xbmc
00:03:26 T:5284   DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnUpdate
00:03:26 T:5284   DEBUG: CVideoDatabase::GetEpisodeId (smb://samba.foo.bar/serien/Burn.Notice/Staffel.01/Burn.Notice.S01E02.Ausgetrickst.German.720p.HDTV.x264-iND/iND-burnnotice-s01e02-720p.mp4), query = select idEpisode from episode where idFile=9888
00:03:26 T:5284   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://samba.foo.bar/serien/Burn.Notice/Staffel.01/Burn.Notice.S01E02.Ausgetrickst.German.720p.HDTV.x264-iND/iND-burnnotice-s01e02-720p.mp4'
00:03:26 T:5284   DEBUG: VIDEO::CVideoInfoScanner::OnProcessSeriesFolder - no match for show: 'Burn Notice', season: 1, episode: 720.0, airdate: '01.01.1601', title: ''
00:03:26 T:5284   DEBUG: CVideoDatabase::GetEpisodeId (smb://samba.foo.bar/serien/Burn.Notice/Staffel.01/Burn.Notice.S01E03.Allein.gegen.das.Kartell.German.720p.HDTV.x264-iND/iND-burnnotice-s01e03-720p.mp4), query = select idEpisode from episode where idFile=9889
00:03:26 T:5284   DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://samba.foo.bar/serien/Burn.Notice/Staffel.01/Burn.Notice.S01E03.Allein.gegen.das.Kartell.German.720p.HDTV.x264-iND/iND-burnnotice-s01e03-720p.mp4'
00:03:26 T:6908  NOTICE: Thread VideoInfoDownloader start, auto delete: false

If i open "http://api.themoviedb.org/3/tv/2919/season/1/episode/2?api_key=57983e31fb435df4df77afb854740ea9&language=de&append_to_response=credits,external_ids,images&include_image_language=de,en,null" the attribute "name" for the episode is empty, but if i remove the "null" from "...,images&include_image_language=de,en,null" it returns the correct values.
find quote
nickr Offline
Team-Kodi Member
Posts: 17,341
Joined: May 2009
Reputation: 348
Location: Christchurch NZ
Post: #21
1. Your log file is incomplete, you have cut bits
2. Your log file is posted here, it should be on a pastebin site

If I have helped you or increased your knowledge, click the 'thank user' button to give thanks :) (People with less than 20 posts won't see the "Thank you" button.)
find quote
kekslieb Offline
Junior Member
Posts: 2
Joined: Mar 2015
Reputation: 0
Post: #22
Yes i have cut the log, this was (in my opinion) the related part but ok, here we go 3370 lines of log:
Part1 & Part2
find quote
bandelguy Offline
Fan
Posts: 540
Joined: Oct 2009
Reputation: 8
Location: India
Post: #23
the movies are showing NR when scrapped by the moviedb.org scraper

CPU:- AMD FX 4100 Motherboard: Gigabyte 78LMT-S2 RAM:-4GB Graphics: AMD HD 7750 1GB DDR5 PSU: IBALL 500W Display: DELL S2240M Storage: 1TB
find quote
nerkaid Offline
Junior Member
Posts: 4
Joined: May 2014
Reputation: 0
Post: #24
Hey, if some of the creators is here, please check this thread:

http://forum.kodi.tv/showthread.php?tid=...pid2015902

And the reply of Travis Bell here:

https://www.themoviedb.org/talk/5567bf6c...466b0002ff

Thanks in advance and best regards!
find quote
markius Offline
Junior Member
Posts: 21
Joined: Jan 2014
Reputation: 0
Post: #25
(2015-01-07 05:43)nickr Wrote:  This is not about movies. It is about a TV scraper.

The link on the Add on page (Add-on:The_Movie_Database (wiki)) points to this thread. Probably the source of the confusion.
find quote
mihawk90 Offline
Senior Member
Posts: 106
Joined: Jan 2011
Reputation: 0
Post: #26
This is probably because the linked Wiki Page is about the TV Show Scraper of TMDB...

Quote:Author: XBMC Foundation
Type: TV information
Version: 1.0.3
Repo: Kodi.tv repo v13
License: GPL v2.0
Summary: TMDB TV show Scraper
find quote
markius Offline
Junior Member
Posts: 21
Joined: Jan 2014
Reputation: 0
Post: #27
So we have a TV scraper named "The Movie Database" while also having a movie scraper named "The Movie Database". I don't think it's a surprise that there is confusion.
find quote
mihawk90 Offline
Senior Member
Posts: 106
Joined: Jan 2011
Reputation: 0
Post: #28
yeah it should probably have some kind of suffix or whatever. Both addons use a completely different API, that's why there are two addons.

Also I would guess you can't easily categorise as both TV and Movie scraper, but I'm not really into addon development.
find quote
Danny3 Offline
Member
Posts: 73
Joined: Aug 2010
Reputation: 0
Location: Italy
Post: #29
Guys,
I have created a ticket for the problems that me and kekslieb are having:
http://trac.kodi.tv/ticket/16019

If you can fix it please do so
This is the only scraper that really supports information in multiple languages for tv shows
I read somewhere that The TVDB won't add any new langages because each new language adds too much load on their database
find quote
scudlee Offline
Team-Kodi Member
Posts: 914
Joined: Jul 2011
Reputation: 59
Post: #30
@Danny3, there's a typo in the scraper, line 223:

"name":"([^\{]*?)","overview"

should be:

"name":"([^\}]*?)","overview"

That's the source of the problem.


@olympia, if you get the chance...
find quote