+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: General Support (https://forum.kodi.tv/forumdisplay.php?fid=111)
+---- Forum: Windows (https://forum.kodi.tv/forumdisplay.php?fid=59)
+---- Thread: Something about scraping (/showthread.php?tid=44909)
Pages:
1
2
Something about scraping - HGBaum - 2009-02-04
Hi!
Can anybody explain the scraping behaviour?
I've strated using Media Companion and/or Movie Info Plus to scrape some contents. nfo-files an tbns have been created. When telling XBMC to refresh the library it reads these files (in my case only after I removed the movie/tv show and rescan for new content, but thats just a sidenote). So far so good.
But other files not scraped by MIP or MC yet, don't get scraped by the XBMC internal Scraper. Is that correct?
I wished the internal scraper kicks in when there are no nfo-files.. Bug or feature? :confused2:
I'm using Jester's 17560 (and before other Versions >17500).
- Hitcher - 2009-02-04
imdb scraper has been disabled so you'll have to select a different one.
- johnny2 - 2009-02-04
Hitcher Wrote:imdb scraper has been disabled so you'll have to select a different one.
Ultra lame. For every step forward XMBC makes, it takes three steps back.
- tslayer - 2009-02-04
Then don't use XBMC. Simple solution right?
- xanadu1979 - 2009-02-04
johnny2 Wrote:Ultra lame. For every step forward XBMC makes, it takes three steps back.
IMDB doesn't give permission for applications to scrape their site. Frankly, every application that does it should stop unless IMDB explicitly says that it's ok.
XBMC is totally doing the right thing with this move.
- HGBaum - 2009-02-04
I know that imdb-scraping doesn't work anymore. Thats not my point. I'm having this trouble(?) with every scraper including thetvdb.com (sorry, I haven't mentioned that before..). So its just me? Do I have a bug or is this behaviour normal?
- WhatMonkey - 2009-02-05
I don't think it is just you. The last couple of days I have not been able to get new TV shows into my library either. I was still trying to figure out if it was something I screwed up or not. I did revert back to an older build (17422 I think?) that I knew worked previously, but even when I did that it still did not import. A clean install with a empty library only imported the show names no episodes. I was thinking it was just something on my side, but if you are having the same problem, maybe not.
- kizer - 2009-02-05
Personally I took all the guess work out and went to Movie Info Plus. I figured I could scrape then upload so everything is in place and I know it works. Movie Info Plus scrapes from the regular places anyways.
I know its one more step and one more app, but it works for me at least.
- TerranQ - 2009-02-05
Something is definitely wrong with scraping. Installed Jester's latest build last night, set it to import my movies at about midnight last night. Got tonight after going out, and still said it was importing. Checked the progress, and no movies had been imported. It gives the name of each movie, and the title of each movie series, but no episodes (for tv series), and no coverart or details for movies. All there is is movie titles and series titles.
And this is after using media companion
- HGBaum - 2009-02-05
Now I tried a new version (Jester 17586). Sometimes some tv shows are scraped correctly, some others aren't.
I tried scraping "Lost" by choosing "Scan for new content" - it worked. Tried scraping new Episodes of "Fringe" or "Nip Tuck", it didn't work.
Additionally, there was a time when that was done automatically on startup. That doesn't seem to work either - it also doesn't save the setting "Run automated scan". Everytime I choose "Set content" the checkbox "Run automated scan" isn't checked.
Here's my debug.log:
http://pastebin.com/m27eb4bd
Does anybod have an idea?
Thanks in advance!!
- xexe - 2009-02-06
Ive just scraped several hundred shows using the latest jester and it worked perfectly fine. This was a clean install with no existing userdata.
As for IMDB whatever it takes it should be brought back. XBMC library is crippled without it, no other source comes close. If it takes a funding drive to buy 100 pro accounts then lets do it
- mitul103 - 2009-02-06
xexe Wrote:Ive just scraped several hundred shows using the latest jester and it worked perfectly fine. This was a clean install with no existing userdata.
As for IMDB whatever it takes it should be brought back. XBMC library is crippled without it, no other source comes close. If it takes a funding drive to buy 100 pro accounts then lets do it
No it shouldn't be brought back. IMDB doesn't want people scraping their website and that should be respected. That said, I don't think there is anything stopping you from grabbing the scrapers from an older build and using them.
- xexe - 2009-02-06
The situation with IMDB is way more complicated than a simple "yes they allow" or "no they dont". Im sure they would be most upset if every XBMC user started downloading a complete copy of their database. That is allowed. Or how about using shell scripts, thats been allowed to for 18 years.
Were going OT here. TV scraping using tvdb as a source works as expected. I retested again a few hours ago.
- Crewone - 2009-02-06
mitul103 Wrote:No it shouldn't be brought back. IMDB doesn't want people scraping their website and that should be respected. That said, I don't think there is anything stopping you from grabbing the scrapers from an older build and using them.
IMDB does allow people or projects to scrape their site WITH PERMISSION.
As as long as the project has permission, which is worked on AFAIK, there should be no reason not to bring it back.
- HGBaum - 2009-02-06
Hey guys, lets try pulling the thread back to its origin.
Perhaps there's some problem in the combination of nfo-files and internal scraped information?
But nonetheless, scraping works not that reliable on my system. Other Idea: some kind of timeout on tvdb? Browsing the website is really slow, too!?