NfoFile with URL don't work with 11.0 beta 2 (bug?)

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #1
I found that URL in Nfo file is completly ignored: in case of xml + url only XML is used and in case of only url file is just ignored.
Looks like that CScraper::Run throw Error when XML in not parsed. So CNfoFile::Scrape return 1 (instead of setting m_scurl and return 0), so CNfoFile::Create return only FULL_NFO or NO_NFO.
Actually CScraper::Run should return somehow URL from NfoFile and CScraper::NfoUrl should return URL to CNfoFile::Scrape.

Correct me if I posted to wrong section.
(This post was last modified: 2012-02-10 16:59 by Karlson2k.)
find quote
live4ever Offline
Fan
Posts: 671
Joined: Sep 2006
Reputation: 6
Post: #2
Post the nfos and I'll try them.
find quote
Sayuuk Offline
Junior Member
Posts: 29
Joined: Sep 2011
Reputation: 0
Post: #3
nfo's work just fine here (URL only).
I've just reinstalled XBMC and scanned, so I know it picks them up.

Cheers
Stefan
find quote
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #4
Same with beta3.
I'm using "kinopoisk" scraper, but for source I select "The MovieDB" scraper - XBMC should select kinopoisk as it match URL.
Log: http://pastebin.com/KHhAM2XP
Content of scanned folders is here: https://www.sugarsync.com/share/d5pfz4j5zcahf
find quote
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #5
Seems that it happen only with kinopoisk, but kinopoisk itself looks OK.
find quote
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #6
Checked deeply: NfoFile works only with tmdb scraper.
Kinopoisk and imdb scrapers didn't catch NfoFile.

Correction: NfoFile works only with default scraper. Other then default scraper isn't checked. That must be a bug.
(This post was last modified: 2012-02-10 16:58 by Karlson2k.)
find quote
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #7
Done some more detective job.
Can't use debugger here so I broke NfoUrl in all Movie Scrapers to see errors in log when it's processed.
Depending on what's used as default scraper for "source" some scrapers are checked when processing NfoFile. If default scraper is "The Movie DB" that only this scraper is checked for NfoUrl section. If any other scraper is default that some (not all) scrapers are checked but process is stopped when "The Movie DB" is processed.
I can't understand how, but processing NfoUrl section in "The Movie DB" always prevent any further processing of other scrappers.
Moreover - the same situation with 10 and 10.1.

How I broke scrapers:
TMDB:
Code:
    <NfoUrl dest="3">
        <RegExp input="$$1" output="&lt;details&gt;&lt;url&gt;http://api.themoviedb.org/3/movie/\2?api_key=57983e31fb435df4df77afb854740ea9&amp;language=$INFO[language]&lt;/url&gt;&lt;id&gt;\2&lt;/id&gt;&lt;/details&gt;" dest="3">
            <expression clear="yes" noclean="1">(themoviedb.org/movie/)([0-9]*)[</expression>
        </RegExp>
        <RegExp input="$$1" output="&lt;details&gt;&lt;url&gt;http://api.themoviedb.org/3/movie/tt\1?api_key=57983e31fb435df4df77afb854740ea9&amp;language=$INFO[language]&lt;/url&gt;&lt;id&gt;tt\1&lt;/id&gt;&lt;/details&gt;" dest="3">
            <expression>imdb....?/title/tt([0-9]*)[</expression>
        </RegExp>
        <RegExp input="$$1" output="&lt;details&gt;&lt;url&gt;http://api.themoviedb.org/3/movie/tt\1?api_key=57983e31fb435df4df77afb854740ea9&amp;language=$INFO[language]&lt;/url&gt;&lt;id&gt;tt\1&lt;/id&gt;&lt;/details&gt;" dest="3">
            <expression>imdb....?/Title\?([0-9]*)[</expression>
        </RegExp>
    </NfoUrl>

IMDB:
Code:
    <NfoUrl dest="3">
        <RegExp input="$$1" output="&lt;url&gt;http://akas.imdb.com/title/tt\1/&lt;/url&gt;&lt;id&gt;tt\1&lt;/id&gt;" dest="3">
            <expression clear="yes" noclean="1">imdb....?/Title\?([0-9]*))</expression>
        </RegExp>
        <RegExp input="$$1" output="&lt;url&gt;http://akas.imdb.com/title/tt\1/&lt;/url&gt;&lt;id&gt;tt\1&lt;/id&gt;" dest="3+">
            <expression noclean="1">imdb....?/title/tt([0-9]*))</expression>
        </RegExp>
    </NfoUrl>

kinopoisk:
Code:
    <NfoUrl dest="3">
        <RegExp input="$$1" output="&lt;url&gt;\1|User-Agent=Mozilla%2F5.0%20(X11%3B%20U%3B%20Linux%20x86_64%3B%20rv%3A2.0.1)%20Gecko%2​F20100101%20Firefox%2F4.0.1&lt;/url&gt;" dest="3">
            <expression noclean="1">(http://www\.kinopoisk\.ru/level/1/film/[0-9]*/))</expression>
        </RegExp>
    </NfoUrl>


Process with TMDb default scrapper:
Code:
15:43:35 T:3308   DEBUG: VideoInfoScanner: No (new) information was found in dir S:\-MovTest\
15:43:35 T:3308   DEBUG: VideoInfoScanner: Scanning dir 'S:\-MovTest\Braveheart\' as not in the database
15:43:35 T:3308   DEBUG: CVideoDatabase::GetMovieId (S:\-MovTest\Braveheart\bh.mkv), query = select idMovie from movie where idFile=1
15:43:35 T:3308   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 32 in expression '(themoviedb.org/movie/)([0-9]*)['
15:43:35 T:3308   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 27 in expression 'imdb....?/title/tt([0-9]*)['
15:43:35 T:3308   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 26 in expression 'imdb....?/Title\?([0-9]*)['
15:43:35 T:3308   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Braveheart' using The MovieDB scraper (path: 'C:\Users\EGrin\AppData\Roaming\XBMC\addons\metadata.themoviedb.org', content: 'movies', version: '3.0.9')

IMDB default scrapper:
Code:
15:44:40 T:5808   DEBUG: CVideoDatabase::GetMovieId (S:\-MovTest\Braveheart\bh.mkv), query = select idMovie from movie where idFile=1
15:44:40 T:6820   DEBUG: ------ Window Deinit (DialogProgress.xml) ------
15:44:40 T:5808   ERROR: PCRE: unmatched parentheses. Compilation failed at offset 25 in expression 'imdb....?/Title\?([0-9]*))'
15:44:40 T:5808   ERROR: PCRE: unmatched parentheses. Compilation failed at offset 26 in expression 'imdb....?/title/tt([0-9]*))'
15:44:40 T:5808   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 32 in expression '(themoviedb.org/movie/)([0-9]*)['
15:44:40 T:5808   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 27 in expression 'imdb....?/title/tt([0-9]*)['
15:44:40 T:5808   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 26 in expression 'imdb....?/Title\?([0-9]*)['
15:44:40 T:5808   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Braveheart' using IMDb scraper (path: 'C:\Users\EGrin\AppData\Roaming\XBMC\addons\metadata.imdb.com', content: 'movies', version: '2.3.4')

kinopoisk default
Code:
15:46:10 T:5460   DEBUG: CVideoDatabase::GetMovieId (S:\-MovTest\Braveheart\bh.mkv), query = select idMovie from movie where idFile=1
15:46:10 T:5460   ERROR: PCRE: unmatched parentheses. Compilation failed at offset 48 in expression '(http://www\.kinopoisk\.ru/level/1/film/[0-9]*/))'
15:46:10 T:5460   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 32 in expression '(themoviedb.org/movie/)([0-9]*)['
15:46:10 T:5460   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 27 in expression 'imdb....?/title/tt([0-9]*)['
15:46:10 T:5460   ERROR: PCRE: missing terminating ] for character class. Compilation failed at offset 26 in expression 'imdb....?/Title\?([0-9]*)['
15:46:10 T:5460   DEBUG: ADDON::CScraper::FindMovie: Searching for 'Braveheart' using KinoPoisk scraper (path: 'C:\Users\EGrin\AppData\Roaming\XBMC\addons\metadata.kinopoisk.ru', content: 'movies', version: '1.0.43')
Note: All scrapper was enabled all the time, only changed default scrapper. According to wiki, all scrappers should be checked for matching Url in Nfo.
(This post was last modified: 2012-02-14 23:13 by Karlson2k.)
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 26,221
Joined: Oct 2003
Reputation: 178
Post: #8
Mind supplying just your nfo file, in addition to whatever you use as scraper settings? In particular, what you have setup for language might be useful.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #9
Link to all used Nfo files is in my post.

Everything is in default values, except Region (set to UK(24) or Central Europe) and Character Set (set to Cyrillic (Windows) as needed for kinopoisk scrapper).
find quote
jmarshall Offline
Team-XBMC Developer
Posts: 26,221
Joined: Oct 2003
Reputation: 178
Post: #10
Link requires signup. A non-signup (eg pastebin one of them) would be great.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules.
For troubleshooting and bug reporting please make sure you read this first.


[Image: badge.gif]
find quote
Karlson2k Offline
Team-Kodi Developer
Posts: 225
Joined: Oct 2010
Reputation: 5
Location: Moscow, Russia
Post: #11
Sorry, didn't know about sign-up.


movie.nfo from "Braveheart" folder:
Code:
http://www.kinopoisk.ru/level/1/film/104938/

movie.nfo from "Naked Gun" folder: http://pastebin.com/mnm5imP6
find quote