Hi
I am having trouble with some concert DVDs which are not correctly scraped even though they are present in TMDB. At first I had the scraper set to IMDB and only added a TMDB URL to the nfo file, but after lots and lots of searching I finally found one post in this thread stating that TMDB links in nfo files are not supported. I think it would help if it said so in the first post or the wiki because if you read the wiki pages for nfo files in general there are TMDB links in the examples.
Well anyway I switched the sourcefolder to universal movie scraper with TMDB, preferred language for titles and so on is DE or German. there are two concerts which are not scraped, even though I can see in the logfile that the correct ID was initially found, but then it omits the ID when downloading the information details.
Log:
Code:
10:32:49 T:1718622544 DEBUG: CAnnouncementManager - Announcement: OnUpdate from xbmc
10:32:49 T:1718622544 DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnUpdate
10:32:49 T:1718622544 DEBUG: int CVideoDatabase::GetMovieId(const CStdString&) (smb://PC-ANDY/f$/Konzerte/Bryan Adams - MTV Unplugged (1997)/VIDEO_TS/VIDEO_TS.IFO), query = select idMovie from movie where idFile=699
10:32:49 T:1718622544 DEBUG: int XFILE::CSMBDirectory::OpenDir(const CURL&, CStdString&) - Using authentication url smb://USERNAME:PASSWORD@PC-ANDY/f%24/Konzerte/Bryan%20Adams%20-%20MTV%20Unplugged%20(1997)
10:32:49 T:1734070736 DEBUG: CCurlFile::GetMimeType - http://image.tmdb.org/t/p/original/exOjr77iCikhWMG46IjGGStmbAG.jpg -> image/jpeg
10:32:49 T:1734070736 DEBUG: CurlFile::Open(0x645d6d08) http://image.tmdb.org/t/p/original/exOjr77iCikhWMG46IjGGStmbAG.jpg
10:32:49 T:1718622544 DEBUG: int XFILE::CSMBDirectory::OpenDir(const CURL&, CStdString&) - Using authentication url smb://USERNAME:PASSWORD@PC-ANDY/f%24/Konzerte/Bryan%20Adams%20-%20MTV%20Unplugged%20(1997)/VIDEO_TS
10:32:49 T:1718622544 DEBUG: CSmbFile::Open - opened f$/Konzerte/Bryan Adams - MTV Unplugged (1997)/movie.nfo, fd=10000
10:32:49 T:1718622544 DEBUG: CSmbFile::Close closing fd 10000
10:32:50 T:1718622544 DEBUG: std::vector<CScraperUrl> ADDON::CScraper::FindMovie(XFILE::CCurlFile&, const CStdString&, bool): Searching for 'Bryan Adams - MTV Unplugged' using Universal Movie Scraper scraper (path: '/storage/emulated/0/Android/data/org.xbmc.xbmc/files/.xbmc/addons/metadata.universal', content: 'movies', version: '2.6.0')
10:32:50 T:1718622544 DEBUG: scraper: CreateSearchUrl returned <url>http://api.tmdb.org/3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&query=Bryan%20Adams%20-%20MTV%20Unplugged&year=1997</url>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&query=Bryan%20Adams%20-%20MTV%20Unplugged&year=1997
10:32:50 T:1734070736 DEBUG: Caching image 'http://image.tmdb.org/t/p/original/exOjr77iCikhWMG46IjGGStmbAG.jpg' to 'f/fa17e49f.jpg':
10:32:50 T:1734070736 DEBUG: cached image 'special://masterprofile/Thumbnails/f/fa17e49f.jpg' size 480x720
10:32:50 T:1718622544 DEBUG: static bool CScraperUrl::Get(const CScraperUrl::SUrlEntry&, std::string&, XFILE::CCurlFile&, const CStdString&): Using "UTF-8" charset for "http://api.tmdb.org/3/search/movie?api_key=57983e31fb435df4df77afb854740ea9&query=Bryan%20Adams%20-%20MTV%20Unplugged&year=1997"
10:32:50 T:1718622544 DEBUG: scraper: GetSearchResults returned <results><entity><title>Bryan Adams - MTV Unplugged</title><id>40268</id><year>1997</year><url cache="tmdb-40268.json">http://api.tmdb.org/3/movie/40268?api_key=57983e31fb435df4df77afb854740ea9</url></entity><entity><title>Bryan Adams - MTV Unplugged</title><id>40268</id><year>1997</year><url cache="tmdb-40268.json">http://api.tmdb.org/3/movie/40268?api_key=57983e31fb435df4df77afb854740ea9</url></entity></results>
10:32:50 T:1718622544 DEBUG: bool ADDON::CScraper::GetVideoDetails(XFILE::CCurlFile&, const CScraperUrl&, bool, CVideoInfoTag&): Reading movie 'http://api.tmdb.org/3/movie/40268?api_key=57983e31fb435df4df77afb854740ea9' using Universal Movie Scraper scraper (file: '/storage/emulated/0/Android/data/org.xbmc.xbmc/files/.xbmc/addons/metadata.universal', content: 'movies', version: '2.6.0')
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/40268?api_key=57983e31fb435df4df77afb854740ea9
10:32:50 T:1718622544 DEBUG: static bool CScraperUrl::Get(const CScraperUrl::SUrlEntry&, std::string&, XFILE::CCurlFile&, const CStdString&): Using "UTF-8" charset for "http://api.tmdb.org/3/movie/40268?api_key=57983e31fb435df4df77afb854740ea9"
10:32:50 T:1718622544 DEBUG: scraper: GetDetails returned <details><id></id><originaltitle>Bryan Adams - MTV Unplugged</originaltitle><year>1997</year><chain function="GetTMDBLangTitleByIdChain"></chain><chain function="GetTMDBCertificationsByIdChain"></chain><runtime>56</runtime><chain function="GetTMDBRatingByIdChain"></chain><chain function="GetTMDBLangGenresByIdChain"></chain><chain function="GetTMDBStudioByIdChain"></chain><chain function="GetTMDBCountryByIdChain"></chain><chain function="GetTMDBLangPlotByIdChain"></chain><chain function="GetTMDBLangTaglineByIdChain"></chain><chain function="GetTMDBCastByIdChain"></chain><chain function="GetTMDBDirectorsByIdChain"></chain><chain function="GetTMDBWitersByIdChain"></chain><chain function="GetTMDBLangSetByIdChain"></chain><chain function="GetTMDBTagsByIdChain"></chain><chain function="GetTMDBLangThumbsByIdChain"></chain><chain function="GetTMDBFanartByIdChain"></chain><chain function="GetTMDBLangTrailerByIdChain"></chain></details>
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBLangTitleByIdChain returned <details><url function="ParseTMDBTitle" cache="tmdb-de-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:50 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:50 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:50 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBCertificationsByIdChain returned <details><url function="ParseTMDBCertifications" cache="tmdb-cert-.json">http://api.tmdb.org/3/movie//releases?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//releases?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:50 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:50 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:50 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBRatingByIdChain returned <details><url function="ParseTMDBRating" cache="tmdb--.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=
10:32:50 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:50 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:50 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBLangGenresByIdChain returned <details><url function="ParseTMDBGenres" cache="tmdb-de-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:50 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:50 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:50 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBStudioByIdChain returned <details><url function="ParseTMDBStudio" cache="tmdb-en-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=en</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=en
10:32:50 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:50 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:50 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBCountryByIdChain returned <details><url function="ParseTMDBCountry" cache="tmdb-en-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=en</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=en
10:32:50 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:50 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:50 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:50 T:1718622544 DEBUG: scraper: GetTMDBLangPlotByIdChain returned <details><url function="ParseTMDBPlot" cache="tmdb-de-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:50 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBLangTaglineByIdChain returned <details><url function="ParseTMDBTagline" cache="tmdb-de-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBCastByIdChain returned <details><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url function="ParseTMDBCast" cache="tmdb-cast-.json">http://api.tmdb.org/3/movie//casts?api_key=57983e31fb435df4df77afb854740ea9</url></details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9
10:32:51 T:1718622544 DEBUG: static bool CScraperUrl::Get(const CScraperUrl::SUrlEntry&, std::string&, XFILE::CCurlFile&, const CStdString&): Using "UTF-8" charset for "http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9"
10:32:51 T:1718622544 DEBUG: scraper: ParseTMDBBaseImageURL returned <details>http://image.tmdb.org/t/p/</details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//casts?api_key=57983e31fb435df4df77afb854740ea9
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBDirectorsByIdChain returned <details><url function="ParseTMDBDirectors" cache="tmdb-cast-.json">http://api.tmdb.org/3/movie//casts?api_key=57983e31fb435df4df77afb854740ea9</url></details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//casts?api_key=57983e31fb435df4df77afb854740ea9
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBWitersByIdChain returned <details><url function="ParseTMDBWriters" cache="tmdb-cast-.json">http://api.tmdb.org/3/movie//casts?api_key=57983e31fb435df4df77afb854740ea9</url></details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//casts?api_key=57983e31fb435df4df77afb854740ea9
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBLangSetByIdChain returned <details><url function="ParseTMDBSet" cache="tmdb-de-.json">http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie/?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBTagsByIdChain returned <details><url function="ParseTMDBTags" >http://api.tmdb.org/3/movie//keywords?api_key=57983e31fb435df4df77afb854740ea9</url></details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//keywords?api_key=57983e31fb435df4df77afb854740ea9
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBLangThumbsByIdChain returned <details><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url function="ParseTMDBLangThumbs" cache="tmdb-images-de-.json">http://api.tmdb.org/3/movie//images?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:51 T:1718622544 DEBUG: scraper: ParseTMDBBaseImageURL returned <details>http://image.tmdb.org/t/p/</details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//images?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:51 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:51 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:51 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:51 T:1718622544 DEBUG: scraper: GetTMDBFanartByIdChain returned <details><url function="ParseTMDBBaseImageURL" cache="tmdb-config.json">http://api.tmdb.org/3/configuration?api_key=57983e31fb435df4df77afb854740ea9</url><url function="ParseTMDBFanart" cache="tmdb-images-.json">http://api.tmdb.org/3/movie//images?api_key=57983e31fb435df4df77afb854740ea9</url></details>
10:32:51 T:1718622544 DEBUG: scraper: ParseTMDBBaseImageURL returned <details>http://image.tmdb.org/t/p/</details>
10:32:51 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//images?api_key=57983e31fb435df4df77afb854740ea9
10:32:52 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:52 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:52 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:52 T:1718622544 DEBUG: scraper: GetTMDBLangTrailerByIdChain returned <details><url function="ParseTMDBTrailer" cache="tmdb-trailer-de-.json">http://api.tmdb.org/3/movie//trailers?api_key=57983e31fb435df4df77afb854740ea9&language=de</url></details>
10:32:52 T:1718622544 DEBUG: CurlFile::Open(0x66595ec0) http://api.tmdb.org/3/movie//trailers?api_key=57983e31fb435df4df77afb854740ea9&language=de
10:32:52 T:1718622544 ERROR: CCurlFile::FillBuffer - Failed: HTTP response code said error(22)
10:32:52 T:1718622544 ERROR: CCurlFile::CReadState::Connect, didn't get any data from stream.
10:32:52 T:1718622544 ERROR: std::vector<CStdStr<char> > ADDON::CScraper::Run(const CStdString&, const CScraperUrl&, XFILE::CCurlFile&, const std::vector<CStdStr<char> >*): Unable to parse web site
10:32:52 T:1718622544 DEBUG: VideoInfoScanner: Adding new item to movies:smb://PC-ANDY/f$/Konzerte/Bryan Adams - MTV Unplugged (1997)/VIDEO_TS/VIDEO_TS.IFO
10:32:52 T:1718622544 DEBUG: int CVideoDatabase::GetMovieId(const CStdString&) (smb://PC-ANDY/f$/Konzerte/Bryan Adams - MTV Unplugged (1997)/VIDEO_TS/VIDEO_TS.IFO), query = select idMovie from movie where idFile=699
You can see that at the lines starting with "scraper: GetSearchResults" and the following lines the ID is returned and used for the lookup, but in the line starting with "scraper: GetDetails returned" the ID is gone. I suspect this is because there is no IMDB ID for this title since it's not present in IMDB. I have the same problem with another concert which is also not present in IMDB.
The problem is the same when I start a manual "update information" and then select the title found in TMDB.
Just for you info: the builtin TMDB scraper doesn't have this problem with these titles, it scraped them just fine. If you need I can post the logfile from this also.
Cheers
Andy