+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Supplementary Tools for Kodi (https://forum.kodi.tv/forumdisplay.php?fid=116)
+--- Thread: XBMC.MyLibrary - Scan any source to the library (Hulu/Netflix/Plugins) (/showthread.php?tid=98210)
- azzbarb - 2011-04-11
hi guys, i just thought i'd let you know to be carefull when using this as i got my self blocked from icefilms for the last few days for using this program, i have had to ask over on icefilms forums to unblock me and they were not very happy, i think its something to do with to many connections to the site get u auto banned.
- icky - 2011-04-12
have scraped over 2000 films so far using this over the last two days... and done 10000 tv episodes before that and i have had no problem with being banned
- azzbarb - 2011-04-12
icky Wrote:have scraped over 2000 films so far using this over the last two days... and done 10000 tv episodes before that and i have had no problem with being banned
well like i said just be carefull as this program was the only thing i was setting up in xbmc and it got me banned, i scraped no where near as much as you so and i have not been streaming lots of stuff off icefilms so i don't know.
heres the link for my thread http://forum.icefilms.info/viewtopic.php?f=24&t=21205
- anarchintosh - 2011-04-12
this is a very cool thing,
BUT it is really pissing off the owners of icefilms.info!!!
it is using A FUCKLOAD of their bandwidth, and is making relations between the XBMC community and icefilms community VERY strained.
i designed my addon in a certain way so as to avoid impacting badly on their bandwidth
ie. not scraping the whole of their site in one go.
- bradvido88 - 2011-04-12
anarchintosh Wrote:this is a very cool thing,Perhaps I designed this tool to be too flexible, in that a user can scrape just 1 video or the entire catalog depending on how he configures it.
BUT it is really pissing off the owners of icefilms.info!!!
it is using A FUCKLOAD of their bandwidth, and is making relations between the XBMC community and icefilms community VERY strained.
i designed my addon in a certain way so as to avoid impacting badly on their bandwidth
ie. not scraping the whole of their site in one go.
Unless someone has a better idea, I will indefinitely disable IceFilms support for this tool. I don't want to cause problems between IceFilms and XBMC
- anarchintosh - 2011-04-12
thanks for the reply bradvido88, i was really impressed by your code, but i don't think its sustainable.
would be nice if you could help smooth things over at
http://forum.icefilms.info/viewtopic.php?f=24&t=21205
and notify icefilms people that you will discontinue icefilms support for the moment.
the only thing is that since i have already made the scrapers, someone could very easily repurpose them in just the same way and have them scrape the entire catalog again. i've suggested icefilms might want to adopt an API to save bandwidth, but i'm not sure how keen they would be to do such a thing...
- bradvido88 - 2011-04-12
anarchintosh Wrote:thanks for the reply bradvido88, i was really impressed by your code, but i don't think its sustainable.Done...
would be nice if you could help smooth things over at
http://forum.icefilms.info/viewtopic.php?f=24&t=21205
and notify icefilms people that you will discontinue icefilms support for the moment.
http://forum.icefilms.info/viewtopic.php?f=24&t=21205&p=76612#p76612
I personally don't use IceFilms, so I don't really care about this.
Download link has been updated to a patched version without icefilms support
- icky - 2011-04-12
http://forum.xbmc.org/showpost.php?p=773831&postcount=761
is this viable
- bradvido88 - 2011-04-18
icky Wrote:http://forum.xbmc.org/showpost.php?p=773831&postcount=761Not really. XBMC's library databases aren't really portable like that. For one, everyone would have to use the same file structure.
is this viable
- icky - 2011-04-18
bradvido88 Wrote:Not really. XBMC's library databases aren't really portable like that. For one, everyone would have to use the same file structure.
yeah, i suggested it with the intention that everyone would be using the default of c:\dropbox
obviously this doesnt work for mac or linux, but for a windows build could it work
- bradvido88 - 2011-04-18
icky Wrote:yeah, i suggested it with the intention that everyone would be using the default of c:\dropboxThe problem is that the XBMC database stores info for every media file that XBMC uses, not just the ones used for this program.
obviously this doesnt work for mac or linux, but for a windows build could it work
It's not a realistic to share XBMC's database between users... too many user-specific things happen in there.
- icky - 2011-04-18
bradvido88 Wrote:The problem is that the XBMC database stores info for every media file that XBMC uses, not just the ones used for this program.
It's not a realistic to share XBMC's database between users... too many user-specific things happen in there.
thats cool,
my plan was that everyone that wanted to use it, fresh installed xbmc inported the library and then imported all their individual movies store locally.... but if its not viable then guess it sback to the drawing board
Trying to Store Stub Files on Secondary Drive - pkscout - 2011-04-21
I have two drives in the HTPC. C: is primarily for programs, system stuff, and the user directories. D: is where all my media is. I created a new folder on D: for the MyLibrary files and created the three sub directories. I setup the Config.xml with the appropriate paths (and checked them three times). Every time I run the x86 batch file I get an error that Java couldn't create the directories.
pastebin log
If I change the config.xml to point to a directory on C: everything works fine. I'm using XBMC-SAGETV with folders on D: with no problem, and all my other XBMC stuff works there fine.
Thoughts?
P.S. don't worry about all the other weird series stuff. I was trying to use the Daily Show plugin (since the Hulu one still isn't working again even with the new librtmp), but it doesn't use standard naming conventions.
I also tested this with the Hulu plugin, and I do get all the right stub files and stuff added to the library, you just can't actually play them...
- ThermoDust - 2011-04-22
Some of my videos are showing as mpg and not strm, is this a normal stage of the process or did I mess something up during the setup?
- bradvido88 - 2011-04-22
pkscuot Wrote:I have two drives in the HTPC. C: is primarily for programs, system stuff, and the user directories. D: is where all my media is. I created a new folder on D: for the MyLibrary files and created the three sub directories. I setup the Config.xml with the appropriate paths (and checked them three times). Every time I run the x86 batch file I get an error that Java couldn't create the directories.That seems strange that it works on the C: drive. Are there any permissions different between the two drives? The files in the dropbox don't take up much room, so you could always keep them on the C: for now.
pastebin log
If I change the config.xml to point to a directory on C: everything works fine. I'm using XBMC-SAGETV with folders on D: with no problem, and all my other XBMC stuff works there fine.
Thoughts?
P.S. don't worry about all the other weird series stuff. I was trying to use the Daily Show plugin (since the Hulu one still isn't working again even with the new librtmp), but it doesn't use standard naming conventions.
I also tested this with the Hulu plugin, and I do get all the right stub files and stuff added to the library, you just can't actually play them...
It may be a bug with the special/season.0 archiving. Have you tested using the Hulu one that actually archives the files correctly?
ThermoDust Wrote:Some of my videos are showing as mpg and not strm, is this a normal stage of the process or did I mess something up during the setup?Yes this is normal. Files are only changed to .strms when they are successfully scanned to XBMC's library.