Help needed with development of new scraper for filmdelta.se (Swedish Movie Scraper)?

  Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Post Reply
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #16
vdrfan Wrote:Uhm, whats the current problem with the scraper? The modified version i've attached to the ticket (see above) is working fine for me.

Well, currently I guess everything that I've implemented is working. I haven't included all possible info from filmdelta though. And the thumbs are way to low resolution, I guess I could fetch them from another place (imdb?) instead, right?

Nicezia Wrote:The nature of web-scraping Tongue
the page is always bound to change Wink

Yep. I've established a communication with the folks behind filmdelta though, my hope is that they could put up something for me that is not as bound to change. Not sure if it's going to happen though...

/Daniel
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #17
spiff Wrote:it happens if you do a manual lookup using 'movie information' from context

Ah. Thanks there mate. I've always wondered Big Grin

/Daniel
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #18
vdrfan Wrote:Uhm, whats the current problem with the scraper? The modified version i've attached to the ticket (see above) is working fine for me.

Darn. Just realized that you actually changed stuff in the xml in the ticket. Thought you just posted my xml right up. Means that I've been working in parallell with you. Eek

I'll incorporate my changes into your xml and post again...

/Daniel
find quote
mkortstiege Offline
Team-Kodi Developer
Posts: 3,016
Joined: Jan 2008
Reputation: 10
Location: Germany
Post: #19
doh! thanks for not ignoring me Smile

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
Nicezia Offline
Fan
Posts: 369
Joined: Nov 2006
Reputation: 0
Location: Montgomery, Alabama
Post: #20
not to be thread jacking, but since there's some attention here, what's the accepted indentation on the XML (how many spaces generally do you use per indentation - so i can get the scraper editor outputting to that standard)

ScraperXML Open Source Web Scraper Library compatible with XBMC XML Scrapers


I Suck, and if you act now by sending only $19.95 and a self addressed stamped envelop, so can you!

[Image: teamumx_sigline.png]
(This post was last modified: 2009-07-27 19:36 by Nicezia.)
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #21
Nicezia Wrote:not to be thread jacking, but since there's some attention here, what's the accepted indentation on the XML (so i can get the scraper editor outputting to that standard)

Yes, I noticed your editor outputting quite ugly intendented code Big Grin

I think the nicest intendention is the one outputted by a "xmllint --format". But that's only my five pence Wink

/Daniel

(And as for hijacking my thread. You will be punished.)
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #22
vdrfan Wrote:doh! thanks for not ignoring me Smile

I'm thoroughly sorry. In reality I'm a nice guy Big Grin

/Daniel
find quote
mkortstiege Offline
Team-Kodi Developer
Posts: 3,016
Joined: Jan 2008
Reputation: 10
Location: Germany
Post: #23
Wink

about the indentation stuff.. I don't like the xmllint output that much as it's really hard to read.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #24
Ok. This is now the result of my and vdrfans joint efforts:

http://trac.xbmc.org/attachment/ticket/6...mdelta.xml

Big question now to vdrfan is: Do you fix fetching of thumbs from tmdb (since you've fixed fetching of fanart anyway) or should I look into it? (I'm assuming here that the thumbs at tmdb is generally more useful than the ones at filmdelta)

/Daniel
find quote
mkortstiege Offline
Team-Kodi Developer
Posts: 3,016
Joined: Jan 2008
Reputation: 10
Location: Germany
Post: #25
Cool. It's up to you Smile I surely can look at this later today if you want me to.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
spiff Offline
Retired Developer
Posts: 12,386
Joined: Nov 2003
Post: #26
do we have a point of translation like imdb id?
find quote
mkortstiege Offline
Team-Kodi Developer
Posts: 3,016
Joined: Jan 2008
Reputation: 10
Location: Germany
Post: #27
Yeah, imdbid is fetched via google and the original title for fanart atm.

Always read the XBMC online-manual, FAQ and search the forum before posting.
Do not e-mail XBMC-Team members directly asking for support. Read/follow the forum rules
For troubleshooting and bug reporting please make sure you read this first.
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #28
Don't think I'll be able to work any more on this tonight. Made a little fix so that the list returned from GetSearchResult actually contains the year (made it a little hard choosing otherwise). Latest version:

http://pastebin.com/m2126d552

/Daniel
find quote
Daniel Malmgren Offline
Senior Member
Posts: 192
Joined: Jul 2009
Reputation: 0
Location: Sweden
Post: #29
vdrfan Wrote:Cool. It's up to you Smile I surely can look at this later today if you want me to.

Ok, now I tried doing it. But xbmc doesn't want the same thing I do Blush

I've got no experience with custom functions, so that might be the problem. Tried looking at the GetTMDBFanart function and made my own GetTMDBPoster, called the same way as GetTMDBFanart. Doesn't get any poster. Where am I thinking wrong?

/Daniel
find quote
spiff Offline
Retired Developer
Posts: 12,386
Joined: Nov 2003
Post: #30
hard/impossible to say without seeing what you did
find quote
Post Reply