+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Development (https://forum.kodi.tv/forumdisplay.php?fid=32)
+--- Forum: Kodi Application (https://forum.kodi.tv/forumdisplay.php?fid=93)
+--- Thread: [ALL PLATFORMS] Fake FS for easier scale testing Shows:1987 Episodes:69535 (/showthread.php?tid=55878)
Pages:
1
2
[ALL PLATFORMS] Fake FS for easier scale testing Shows:1987 Episodes:69535 - xexe - 2009-08-05
Previously I have been asked for a dump of my dbase by at least 3 devs over the last year. For confidentiality reasons I was loathed to do this.
So I decided to create a fake file system of episodes. These episodes should all exist at tvdb.com as i used their database dump as a reference point (albeit the dbase is 5 months out of date).
Each show is is in its own folder named after the show and includes a tvshow.nfo. The episodes themselves are 0kB text files renamed to an XBMC compliant avi names.
Whilst there are Shows:1987 and Episodes:69535 the entire download is only 800kB
In theory you should be able to start with a fresh database, add this fake fs as a source and leave it to run with no user input.
Watzen has already agreed to scrape these shows then export to files so that all the nfos and artwork are included in the fake fs as well. Unfortunately i do not have the bandwidth to do this myself.
This is my first pass and can relatively easily alter it if required.
Hopefully this will help by allowing devs to use a HUGE common database to test XBMC scaling.
Download it here: Link removed contained some stray windows restricted filename characters
New link: Shows:1979 and Episodes:69208 http://www.datafilehost.com/download-8c4c156d.html
Movie Link: Movies: 1472 http://www.datafilehost.com/download-b4ae283f.html
- mkortstiege - 2009-08-05
Thanks mate!
- xexe - 2009-08-05
No problems at all.
I managed to grab Watzen via IRC and he has started scraping the content already. Once the nfos and art is added this 800kB file will be more like hit 2GB so there may be a distribution hurdle to get over.
One thing that also occurred to me is that a subset of this might be nice for users to download to see how a proper library looks but more interestingly it could function as a killa type sample but testing the library capabilities of an HTPC rather than the video playback.
We will see how we get on
- spiff - 2009-08-05
make a torrent
'1987 free tvshows including 69535 episodes of which one third includes nudity by justin timberlake, one third nudity by megan fox while the final third is a secrat season of twilight based on a yet-to-come book'.
leechers will jump on it thinking they are in some new awesome format and the mafiaa will go mad!
- CapnBry - 2009-08-05
spiff Wrote:'1987 free tvshows including 69535 episodes'"... and Justin Timberlake"
- mkortstiege - 2009-08-05
- fekker - 2009-08-05
good one spiff
thanks for the test files as well, i'll use these with UMC to tweak the loader for tv shows.
- xexe - 2009-08-05
I can almost certainly do this for IMDB based movies as well if there is a demand.
Just say and i will do it.
- fekker - 2009-08-06
xexe Wrote:I can almost certainly do this for IMDB based movies as well if there is a demand.
Just say and i will do it.
sure, that would be a good test set as well
- jmarshall - 2009-08-06
Nice - greatly appreciated.
You say this was sourced from thetvdb.com?
It'd be good for scalability in that case, but I guess not so much for "scrapability" (as one presumes the scraping would be flawless, given you got the filenames set up based on what thetvdb.com supplied).
Cheers,
Jonathan
- xexe - 2009-08-06
Hidden away in the tvdb forums is a post that has a single download link to the entire tvdb dbase. It 5 months out of date now but i used that as the starting point. So likely it wont be 100% accurate with moves and changes but its as close as we are ever going to get.
Whats the preference for imdb... random old and modern I assume?
- xexe - 2009-08-06
Update:
Watzen has completed the scrape of the tvshows. I have created a new fake fs for 1472 movies and they are being scraped and exported as we speak.
This will be distributed via torrent in the next few days.
- watzen - 2009-08-06
And here we have the fake filesystem-torrent:
http://www.mediafire.com/?zmiiyoiegy2
It uses the openbittorrent-tracker. Let me know if it doesn't work any good.
it contains three files:
MyVideos34.db - The databasefile with all the info scraped. Ofcourse this is bound to my paths, but I reckon that if you want these files, you'd know how to change those paths.
movies...blabla.rar - A folderstructure with ~1500 movies that has corresponding nfo's, thumbs and fanart. all scraped using the imdb scraper in xbmc.
tv-shows...blabla.rar - A folderstructure with apprx 2000 shows with ~60000 episodes in total. All with nfo's thumbs and fanart. Scraped with tmdb scraper in xbmc.
- fekker - 2009-08-06
edit.. got it
thanks for putting these together
- Freddo - 2009-08-06
This may actually be as handy for skinners as for developers.