Kodi Community Forum
v20 TheSportsDB Python Scraper (for Nexus and Later) - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: TV Show Scrapers (https://forum.kodi.tv/forumdisplay.php?fid=305)
+----- Thread: v20 TheSportsDB Python Scraper (for Nexus and Later) (/showthread.php?tid=368208)

Pages: 1 2 3


RE: TheSportsDB Python Scraper (for Nexus and Later) - htpc-mac - 2023-06-28

Here is the directory listings I have. I name the folder according to theSportsDB. This usually indexes it correctly and no further renaming is necessary. In this picture I added special but did not change the date format to remove the dashes, which is necessary for the special tag to work. In my limited testing all it did was change the event from "Episode number - name of event" to "Event name" (13. UFC on Disney Solo vs Vader changes to UFC on Disney Solo vs Vader)
Image
This is how the library works (stacking is enabled in Kodi Settings)
Image

This is how a widget (Video Library -> Source -> Season 2023) looks, which is how I'd like the library to look.
Image

Since there is no such thing as prelims or early prelims on the DB, adding them would cause problems if you use just the date due to some of them being the 'day before UTC' while the event is another day, but the same 'night'.

I think the perfect solution would be a way to go 'another level deeper' on episodes through the skin. This has no practical use in TV shows so I don't see why it would ever be added.


RE: TheSportsDB Python Scraper (for Nexus and Later) - htpc-mac - 2023-07-06

Zag, I have an idea that might be easy to implement without causing too much work to the database. 
Detection of 'prelims.special' or 'early.prelims.special' within the event, that does not count as a separate event but merely adds a overlay to the poster that says 'prelims'?

Image


RE: TheSportsDB Python Scraper (for Nexus and Later) - Publish3r - 2023-08-07

Hello @pkscout

I can't get it working with the German 2. Bundesliga.
I want to scrape the matches of Schalke 04. (the first 2 matches of the new season against hamburg and kaiserslautern)
https://www.thesportsdb.com/team/133661
I tryed different folder structure and filenames without success.
Can you help me, please?
What folder structure and filenames will work?

Thank you.


Edit:
It's working now.


RE: TheSportsDB Python Scraper (for Nexus and Later) - nihlathak - 2023-08-14

So this is probably more a TheSportsDB issue than the scrapers fault, but I could use some help anyway.

I'm happy to finally have a scraper for my sport content.

My files are now ordered like this:
Code:
/UFC/Season 2023/UFC.2023-06-11.UFC.289.Nunes.vs.Aldana.WEBDL-1080p.mkv
/UFC/Season 2023/UFC.2023-07-09.UFC.290.Volkanovski.vs.Rodriguez.WEBDL-1080p.mkv
/UFC/Season 2023/UFC.2023-07-29.UFC.291.Poirier.vs.Gaethje.2.WEBDL-1080p.mkv
Some feedback; it would have been nice if the UFC numbered events could just be parsed by their number. To make sure to adhere to the scrapers requirements for gathering information, I am using a custom script to parse the timestamp of the event from the official UFC website and convert it into a YYYY-MM-DD formatted date.

I have noticed that TheSportsDB uses UTC timestamps. However, it does not seem to do this for all events. The latest numbered card (UFC 291) was on Sunday 30 July 2023 UTC. For this particular event, they decided to go with the EDT timezone which is Saturday 29 July EDT.

At least for now, I am unable to have my script check for both timezones, as my script is purely altering the filename of the UFC content.

Any tips on what I can do? Should I report this directly to TheSportsDB staff?


RE: TheSportsDB Python Scraper (for Nexus and Later) - pkscout - 2023-08-14

(2023-08-14, 15:20)nihlathak Wrote: So this is probably more a TheSportsDB issue than the scrapers fault, but I could use some help anyway.

I'm happy to finally have a scraper for my sport content.

My files are now ordered like this:
Code:
/UFC/Season 2023/UFC.2023-06-11.UFC.289.Nunes.vs.Aldana.WEBDL-1080p.mkv
/UFC/Season 2023/UFC.2023-07-09.UFC.290.Volkanovski.vs.Rodriguez.WEBDL-1080p.mkv
/UFC/Season 2023/UFC.2023-07-29.UFC.291.Poirier.vs.Gaethje.2.WEBDL-1080p.mkv
Some feedback; it would have been nice if the UFC numbered events could just be parsed by their number. To make sure to adhere to the scrapers requirements for gathering information, I am using a custom script to parse the timestamp of the event from the official UFC website and convert it into a YYYY-MM-DD formatted date.

I have noticed that TheSportsDB uses UTC timestamps. However, it does not seem to do this for all events. The latest numbered card (UFC 291) was on Sunday 30 July 2023 UTC. For this particular event, they decided to go with the EDT timezone which is Saturday 29 July EDT.

At least for now, I am unable to have my script check for both timezones, as my script is purely altering the filename of the UFC content.

Any tips on what I can do? Should I report this directly to TheSportsDB staff?
Technically you can do matching on "season" and "episode" number by using the format <show>.S01E01.<episode title>.  The key is though that the season and episode number have to match what The SportsDB has, and I don't know if that would be, for instance, UFC.S2023E289.Nunes.vs.Aldana, or something else.  It depends on how that data is stored, and I can't remember if it's displayed anywhere on the web site or only returned by the API.  This is one of the drawbacks of having someone write a scraper as a favor even though they don't watch any sports at all.  '-)


RE: TheSportsDB Python Scraper (for Nexus and Later) - nihlathak - 2023-08-15

I wouldn't know where to get that data from pre-parsing =) However, I did find out that there's an option to edit entries on TheSportsDB. Looks like I have to become an editor myself.


RE: TheSportsDB Python Scraper (for Nexus and Later) - Iambernash - 2023-08-29

Hi Sir, please i have the fifa world finals 2022 but its in 5 parts.

1. First Half
2. Second Half
3. Extra Time
4. Penalties
5. Awards Ceremony

Please any idea the final i should use to scrap all 5 parts into Kodi?

Thanks, any help is appreciated

https://www.thesportsdb.com/forum_topic.php?t=5654

The link above looks like the file name suggested is for one file

Thank you


RE: TheSportsDB Python Scraper (for Nexus and Later) - pkscout - 2023-08-29

(2023-08-29, 05:02)Iambernash Wrote: Hi Sir, please i have the fifa world finals 2022 but its in 5 parts.

1. First Half
2. Second Half
3. Extra Time
4. Penalties
5. Awards Ceremony

Please any idea the final i should use to scrap all 5 parts into Kodi?

Thanks, any help is appreciated

https://www.thesportsdb.com/forum_topic.php?t=5654

The link above looks like the file name suggested is for one file

Thank you
There isn't going to be any way to do that.  If the SportsDB has all those things listed as one event, Kodi has no mechanism for scraping all those files and putting them under one entry.


RE: TheSportsDB Python Scraper (for Nexus and Later) - Karellen - 2023-08-30

There are two ways to achieve that...

1. Scrape those parts all as S01E01
S01E01 First Half
S01E01 Second Half
S01E01 Extra Time
S01E01 Penalties
S01E01 Awards Ceremony

Then edit the titles in Kodi via Context Menu>Manage>Edit Title

2. Better method is to use nfo files.
Scrape the first episode S01E01 First Half, then export to nfo files. (its better if you use a Portable install for this so you don't muck up your main library)
Copy the nfo file to each of the other parts and rename them to S01E02, S01E03 etc
Then open each nfo file and edit the data, then scan into Kodi.

@pkscout, does this scraper still use the S01E01 format?
I am not a sporting person, so haven't really looked at this scraper.


RE: TheSportsDB Python Scraper (for Nexus and Later) - Iambernash - 2023-08-30

Sad.

Well Noted


RE: TheSportsDB Python Scraper (for Nexus and Later) - Iambernash - 2023-08-30

(2023-08-30, 00:40)Karellen Wrote: There are two ways to achieve that...

1. Scrape those parts all as S01E01
S01E01 First Half
S01E01 Second Half
S01E01 Extra Time
S01E01 Penalties
S01E01 Awards Ceremony

Then edit the titles in Kodi via Context Menu>Manage>Edit Title

2. Better method is to use nfo files.
Scrape the first episode S01E01 First Half, then export to nfo files. (its better if you use a Portable install for this so you don't muck up your main library)
Copy the nfo file to each of the other parts and rename them to S01E02, S01E03 etc
Then open each nfo file and edit the data, then scan into Kodi.

@pkscout, does this scraper still use the S01E01 format?
I am not a sporting person, so haven't really looked at this scraper.

Will Look into this option and give feedback. I have a fair idea of method 1 only though. Have no idea how to handle method 2 which appears to be a better method


RE: TheSportsDB Python Scraper (for Nexus and Later) - pkscout - 2023-08-30

(2023-08-30, 00:40)Karellen Wrote: @pkscout, does this scraper still use the S01E01 format?
I am not a sporting person, so haven't really looked at this scraper.
It can, but the season and episode numbers are internal to the dataset.  They aren't exposed anywhere on the web site.  So you kind of have to infer the season and episode number by counting things.  It's less than ideal, and I don't think many people use that naming convention because of it.


RE: TheSportsDB Python Scraper (for Nexus and Later) - tjost195 - 2024-01-03

I did not get it how I do need to name my formula 1 videos to get it scrapped.


RE: TheSportsDB Python Scraper (for Nexus and Later) - zag - 2024-01-15

(2024-01-03, 21:28)tjost195 Wrote: I did not get it how I do need to name my formula 1 videos to get it scrapped.

See filename at the bottom here

https://www.thesportsdb.com/event/1671872-Abu-Dhabi-Grand-Prix


RE: TheSportsDB Python Scraper (for Nexus and Later) - peter0123 - 2024-05-31

Hi, ich habe meinen Scraper überarbeitet, er war das Erste Projekt mit der SportsDB.
Vielleicht lassen sich Verbesserungen zusammenführen, Ziel ist auch ein Video-Plugin bzw. Screensaver.

Zu finden unter: [TSDB] - The Sports Database Video Scraper


This forum uses Lukasz Tkacz MyBB addons.