Kodi Community Forum

Full Version: XBMC extremly slow while scraping
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2
Hi,

I am new to XBMC - used Mediaportal before. I am thinking about switching completly to XBMC. At the moment it is scraping my TV Shows.
Unfortunatly it takes much longer than expected. I have .nfo-files, Fanarts and so one for every show and episode. I used Ember Media Manager to create/download the nfo-files and images. In spite of the downloaded information it takes about 10 seconds for each episode on a Phemom II X3 with 4GB ram to scrape an episode.
XBMC itself is extremly slow while it is scraping the files. I would it's unusable.

Am I do something wrong or is scraping with XBMC that slow?

Best regards,
fish12345
Shouldn't be that slow and it should do it in the background without effecting the performance.

Debug log of doing a scan may show whats wrong.
Hi,

I've enabled debug-output and looked at the logfile. I can not find anything which seems to be bad. But as you can see, there are 10 seconds between two episodes where it does nothing important?!

FPS of debug output says something between 0.3fps and 9 fps most of the time. Sometimes it jumps to 50fps for a short time. CPU load is about 30%.
XBMC runs smooth if it does not scrape anything. Also DXVA with HD-content works great.

Logfile:
Code:
20:42:00 T:3128 M:2711412736   DEBUG: VideoInfoScanner: Found matching Full NFO file: Z:\movies\serien\Private Practice\Staffel 1\09 - Dell lernt zu kämpfen.nfo
20:42:00 T:3128 M:2711412736   DEBUG: VideoInfoScanner: Adding new item to tvshows:Z:\movies\serien\Private Practice\Staffel 1\09 - Dell lernt zu kämpfen.avi
20:42:01 T:3128 M:2710773760    INFO: Caching image from: Z:\movies\serien\Private Practice\Staffel 1\09 - Dell lernt zu kämpfen.tbn to special://masterprofile/Thumbnails/Video/0/092b4fc6.tbn with width 512 and height 512
20:42:01 T:3128 M:2710687744   DEBUG: Win32DllLoader::Load(ADVAPI32.DLL)
20:42:01 T:3128 M:2710687744   DEBUG: Win32DllLoader::Load(KERNEL32.DLL)
20:42:01 T:3128 M:2710687744   DEBUG: Win32DllLoader::Load(NETAPI32.DLL)
20:42:01 T:3128 M:2710495232   DEBUG: FreeLibrary(NETAPI32.DLL) -> 06AC1650
20:42:01 T:3128 M:2710495232   DEBUG: Win32DllLoader::Unload NETAPI32.DLL
20:42:01 T:3128 M:2710675456   DEBUG: FreeLibrary(ADVAPI32.DLL) -> 06AC17E0
20:42:01 T:3128 M:2710675456   DEBUG: Win32DllLoader::Unload ADVAPI32.DLL
20:42:01 T:3128 M:2710532096   DEBUG: Win32DllLoader::Load(USER32.DLL)
20:42:01 T:3128 M:2710482944   DEBUG: FreeLibrary(USER32.DLL) -> 06AC17E0
20:42:01 T:3128 M:2710474752   DEBUG: Win32DllLoader::Unload USER32.DLL
20:42:02 T:3128 M:2702581760   DEBUG: FreeLibrary(KERNEL32.DLL) -> 06AC1A60
20:42:02 T:3128 M:2702581760   DEBUG: Win32DllLoader::Unload KERNEL32.DLL
20:42:05 T:4776 M:2686193664   DEBUG: Thread 4776 terminating (autodelete)
20:42:05 T:3128 M:2686349312   DEBUG: Win32DllLoader::Load(secur32.dll)
20:42:05 T:3128 M:2686324736   DEBUG: FreeLibrary(secur32.dll) -> 06AC1A60
20:42:05 T:3128 M:2686324736   DEBUG: Win32DllLoader::Unload secur32.dll
20:42:05 T:3128 M:2686328832   DEBUG: Win32DllLoader::Load(ADVAPI32.DLL)
20:42:05 T:3128 M:2686324736   DEBUG: Win32DllLoader::Load(KERNEL32.DLL)
20:42:05 T:3128 M:2686328832   DEBUG: Win32DllLoader::Load(NETAPI32.DLL)
20:42:05 T:3128 M:2686140416   DEBUG: FreeLibrary(NETAPI32.DLL) -> 06B98808
20:42:05 T:3128 M:2686140416   DEBUG: Win32DllLoader::Unload NETAPI32.DLL
20:42:05 T:3128 M:2686328832   DEBUG: FreeLibrary(ADVAPI32.DLL) -> 06B98858
20:42:05 T:3128 M:2686328832   DEBUG: Win32DllLoader::Unload ADVAPI32.DLL
20:42:05 T:3128 M:2686328832   DEBUG: Win32DllLoader::Load(USER32.DLL)
20:42:05 T:3128 M:2686328832   DEBUG: FreeLibrary(USER32.DLL) -> 06B98858
20:42:05 T:3128 M:2686328832   DEBUG: Win32DllLoader::Unload USER32.DLL
20:42:07 T:3128 M:2686308352   DEBUG: FreeLibrary(KERNEL32.DLL) -> 06B984E8
20:42:07 T:3128 M:2686398464   DEBUG: Win32DllLoader::Unload KERNEL32.DLL
20:42:10 T:3128 M:2683375616   DEBUG: Win32DllLoader::Load(secur32.dll)
20:42:10 T:3128 M:2683400192   DEBUG: FreeLibrary(secur32.dll) -> 06B984E8
20:42:10 T:3128 M:2683400192   DEBUG: Win32DllLoader::Unload secur32.dll
20:42:10 T:3128 M:2683420672   DEBUG: VideoInfoScanner: Found matching Full NFO file: Z:\movies\serien\Private Practice\Staffel 2\01 - Familienangelegenheit.nfo
20:42:10 T:3128 M:2683416576   DEBUG: VideoInfoScanner: Adding new item to tvshows:Z:\movies\serien\Private Practice\Staffel 2\01 - Familienangelegenheit.avi
20:42:10 T:3128 M:2676166656    INFO: Caching image from: Z:\movies\serien\Private Practice\Staffel 2\01 - Familienangelegenheit.tbn to special://masterprofile/Thumbnails/Video/c/c5c1e3f4.tbn with width 512 and height 512

I was thinking about running XBMC on the Atom-ION-system I bought for my girlfriend but I guess I have to switch to something with less hardware requirements.

Best regards,
fish12345
Post a full debug log please - not just a snippet of it.

On a side issue, xbmc runs perfectly fine on ion based platforms - i have several here alone.
Thanks for your help so far. I've read stories by many users running XBMC on ION - this was the reason why I bought the Acer Revo 3610. But seeing my Phenom-System so slow, just made me mistrustful.

I uploaded the whole logfile. Is it important that the tv shows are one a mapped samba-drive?

Great regards,
fish12345
it won't be much slower slower on the atom.. it's not really cpu bound. apperently we are causing a shitload of disk access on scraping thou. there is another forum thread about it.
Thanks for that information.
Actually it's not a real problem, because scraping all my tv shows won't be necassary more than once (hopefully Rolleyes) on one client.

Are you still working on the problem or is it something which won't be fixed soon?

XBMC is really great, thanks to all developers and helpers in this forum.

Best regards,
fish12345
prae5 Wrote:Shouldn't be that slow and it should do it in the background without effecting the performance.

Debug log of doing a scan may show whats wrong.

Actually scrapers use about 40% of ram based on 2GB, I would dare say that affects performance.
i scraped my moderately sized library yesterday, due to you mentioning ^^^. i never went above 10% mem usage on my system (out of 1.5gb - so that's about 150mb ram). that includes everything.

regarding the slowness, it's definitely a windows problem.
Good to know that it is a Windows-Problem.
Unfortunatly I need Windows at least on my girlfriend's machine. Probably will switch to Linux on my personal HTPC when I am willing to disclaim mediaportal completely.
spiff Wrote:i scraped my moderately sized library yesterday, due to you mentioning ^^^. i never went above 10% mem usage on my system (out of 1.5gb - so that's about 150mb ram). that includes everything.

regarding the slowness, it's definitely a windows problem.

Over todays compile, the "hogging" seems to be gone, however I have to test when I purposefully make my nas unresponsive juts to compare.

The excessive ram consumption I have seen it randomly when scrapping or after playing some file, resources dont seem to be released.

Again this is random behaviour.
This happened to me today while updating my library. It took close to a minute for each movie. I have have .nfo's fanarts and posters stored locally.
What I did to prevent the scraper to be so extremely slow was to close XBMC, kill my internet connection and then start xbmc again.
Now 50 movies were added to my library within a minute.

EDIT: Just updated from r32748 to the most recent nightly. Problem seems to be fixed. Everything working as it should.
I will try the current nightly this evening, as well. Thanks for the information.
Btw, I am quite sure that XBMC used the information I stored in the nfo-files and did not connect to the internet. So WhyS' solution, probably would not work for me.

Best regards,
fish
It appears that this is ONLY an issue on Windows 7 64 bit. Does this ring true?
I experienced it on a 32 bit Win 7 Home Premium, too. Since I'm currently at work I don't know which build of xbmc is installed.

I can recheck against the newest nightly this evening, if you want me to.
Pages: 1 2