Scraper issues
#1
Hi,

I recently upgraded to Frodo beta 3 from Eden (actually, a fresh install), and I am having a real speed issue with movie scrapers. When I first installed the system, I kicked off the library update and didn't touch the machine for a while, so I have no idea how long it took. A week later, I added a dozen movies and updated. After 30 minutes or so, it still hadn't added any new movies (or made any real progress).

I decided to rebuild the entire database, and I found that it was taking roughly 1-2minutes per movie in the scraper. In Eden it seemed to only take a couple seconds per movie.

I have hunted around trying to find a solution for this issue, but I only find unanswered questions. I have even tried going back to Eden, and it has the same issue. Is it possible that IMDB is limiting the number of requests per day?

Hopefully someone has some insight for me!

- Using the universal scraper w/ default settings (the default scraper threw errors)
- I have a 35Mb pipe, that is not being stressed at all. I can easily minimise XBMC, open a browser to imdb, and search for the movie without any lag.
- The machine is on the slow side (Intel® Pentium® 4 CPU 2.80GHz; NVIDIA GeForce4 MX 440 with AGP8X), but it wasn't an issue in Eden.
- Running XP sp2
- My media is stored on a read-only network windows share over a 1Gb link.
- I have a very basic configuration. Just a few add-ons installed.
- User that I am logged in as does not have admin privileges, but does have full control over the XBMC program files directory
- CPU is running at ~20-30% (like normal)
- I am seeing a lot of warnings
16:06:05 T:1808 WARNING: Previous line repeats 2 times.
16:06:05 T:1808 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: Reconnect failed!
16:06:05 T:1808 ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
16:06:05 T:1808 ERROR: ADDON::CScraper::Run: Unable to parse web site
16:06:15 T:1808 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 28
16:06:50 T:1808 WARNING: Previous line repeats 2 times.
16:06:50 T:1808 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: Reconnect failed!
16:06:50 T:1808 ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
16:06:50 T:1808 ERROR: ADDON::CScraper::Run: Unable to parse web site
16:07:00 T:1808 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 28
16:07:30 T:360 WARNING: Previous line repeats 1 times.
16:07:30 T:360 NOTICE: Thread Jobworker start, auto delete: true
16:07:30 T:1808 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: curl failed with code 28
16:07:30 T:1864 NOTICE: Thread Jobworker start, auto delete: true
16:07:36 T:1808 WARNING: XFILE::CCurlFile::CReadState::FillBuffer: Reconnect failed!
16:07:36 T:1808 ERROR: CCurlFile::CReadState::Open, didn't get any data from stream.
16:07:36 T:1808 ERROR: ADDON::CScraper::Run: Unable to parse web site
16:07:36 T:1808 ERROR: XFILE::CDirectory::GetDirectory - Error getting \\routeguy\movies\.actors
16:07:45 T:904 WARNING: CWin32DirectSound::GetSpace - buffer underrun - W:26216, P:19104, O:22416.
16:07:50 T:904 WARNING: CWin32DirectSound::GetSpace - buffer underrun - W:41352, P:34240, O:36800.
Reply
#2
I'm getting this also. But 'curl failed with code 6'
Reply

Logout Mark Read Team Forum Stats Members Help
Scraper issues0