Thread Rating:
  • 3 Vote(s) - 5 Average
Release - [TSDB] - The Sports Database Video Scraper
#1
The Sports Database Video Scraper

Image
metadata.thesportsdb.com
Current Version: 0.9.1

Description:
This scraper is a part of an idea that the user n1md4 has launched on the 02.10.2013.
Target: Cover Sports Films/Series Area in Kodi

Current Components of this Idea: If you want to help, we need more helping hands for the extension of the database entries + artwork.

My Area in this Idea:
  1. The Sports Database Scraper (to add and associate files)
  2. The Sports Database Live (own custum rss feeds, notification via email, pop up..)
  3. The Sports Database Home (My SportsDB - to vote, add, correct entrys, upload trailer or cuts from event, live screenshots...)

Support in Beta Stage:
Planned Improvements:
  • Better dealing with Episode Numbers
  • Season Naming: 2015/1516
  • More Artwork
  • More Addon Translations
  • Addon to Export his own Collection Information

This Scraper collects Information from the following Sites:
  • TheSportsDB.com - TheSportsDB is an online source of sports metadata that is maintained by its users. Sign up and start adding events, artwork or details to keep the database growing. Why not update your favourite team or add some results for an event. Any new data will help everyone!

Changelogs:
  • 0.9.1 - xxx

Downloads:
Reply
#2
Awesome job, thanks @zag, @enen92 and @peter0123
Reply
#3
Great work everyone.

Can you get it up on GitHub so we can see the code easily?

I will have a look at some of your suggestions again, now the Add-On is released.
Reply
#4
Thanks for this scraper, going to test and report any issues if found.
Also going to finish Sports Center for Aeon MQ6/7
Btw, Example File structure link seems to be broken.
Reply
#5
This is brilliant, peter, you know that from me already. Good work!

Noticed these links need fixing though:

(2016-01-12, 23:39)peter0123 Wrote:
HTPC RPI3 Kodi 17 (Krypton) v8.0.1 MR
Storage BPI 1x 500GB SSD UPnP server
Display Sony Bravia 32"
Reply
#6
Please update the example file structure link, I'm struggling to get it to work for my WWE library.
Reply
#7
Try this link

http://www.repo-kodi.sem-one.de/alpha-tests/

The test file is called "Sport_EN_RDY.zip"

I have not had a chance to play around with it yet so can't help much sorry. If someone who gets it working could explain how it all fits together that would be great. A guide even better Smile
Reply
#8
(2016-01-15, 18:32)zag Wrote: Try this link

http://www.repo-kodi.sem-one.de/alpha-tests/

The test file is called "Sport_EN_RDY.zip"

I have not had a chance to play around with it yet so can't help much sorry. If someone who gets it working could explain how it all fits together that would be great. A guide even better Smile

Thanks. he must have updated it since because I did check the root and all the folders.

I've just downloaded that .zip and it looks pretty self-explanatory, I'm going to give it a shot now.
Reply
#9
Looks to work fine, a slight bug is that you can't have extra numbers in the title. So Wrestlemania 31 whose suggested filename is 'WWE 2015-03-29 WrestleMania 31(.xxx)' didn't scrape but when I changed it to 'WWE 2015-03-29 WrestleMania(.xxx)' it worked fine.

Fanart and posters don't seem to be coming through but that could be because they're being scraped in TV show format instead of as movies which might accommodate different fanart and posters for each 'episode'. Thumbnails are scraped fine.

http://imgur.com/RQ4rUfX

Image

Edit: I've updated all the thumbs for 2015 on TSDB and I think it looks considerably better now.

Image
Reply
#10
I have tested on my collection and works perfect on F1, which only have 1 file by episode, but it doesn't work on sports based on several files by round/episode such basketball & soccer. Any clue?

Here you can see an example of my current test file structure:

Image


PS: NBA has being detected as TV show, but without any episode displayed on it
Image

Kodi 16 + Aeon MQ 5 Helix Mod
Mac Mini (late 2014) + OS X 10.10.3 Yosemite + iOmega MiniMax Desktop + NewerTech miniStack
Sony Bravia 42" + Sony DAV-F200


Reply
#11
I'm experimenting to see if I can find the right naming format for it.

It doesn't help that it takes forever to refresh data due to the NBA database being so large on TSDB.
Reply
#12
I think I've solved the problem.

Your file naming and folder structure is fine.

I discovered what the problem was by loading in the 'German Bundesliga' dummy folders and files and scraping them, seasons 12-13 to 15-16 all loaded fine but the ones before didn't scrape. Looking at the database I noticed the seasons that were scraped had round numbers inserted, I tested this by changing a round number in 11-12 and scraping, it worked fine.

So the solution is to add round numbers, but this seems bugged as I haven't been able to scrape games that have taken place on the same date or that occur in the same round.

Hopefully this shows the problem I'm encountering.
Image
Image
Reply
#13
Thank you!
Image

Kodi 16 + Aeon MQ 5 Helix Mod
Mac Mini (late 2014) + OS X 10.10.3 Yosemite + iOmega MiniMax Desktop + NewerTech miniStack
Sony Bravia 42" + Sony DAV-F200


Reply
#14
Finally had a chance to play with this, what a great improvement to Kodi!!

Heres my file structure
Image

And the TVShow root
Image

And the WWE Sport
Image

Great work everyone, a real team effort!
Reply
#15
Does anyone know if there is there any way to get a poster episode view?
Reply



[TSDB] - The Sports Database Video Scraper53