Kodi Community Forum
Req Sports scraper - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: Add-on Support (https://forum.kodi.tv/forumdisplay.php?fid=27)
+---- Forum: Information Providers (scrapers) (https://forum.kodi.tv/forumdisplay.php?fid=147)
+----- Forum: General Scraping (https://forum.kodi.tv/forumdisplay.php?fid=306)
+----- Thread: Req Sports scraper (/showthread.php?tid=174789)

Pages: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23


RE: Sports scraper - Ovokx - 2015-01-05

I have detected some teams without its relative league created on the DB:

Akçaabat Sebatspor :: Regional Amateur League (Turkey)
Alemannia Aachen :: Fifth division (Germany)
Anorthosis Famagusta :: First Division (Cyprus)
Apoel Nicosia :: First Division (Cyprus)
BATE Borisov :: Vysshaya Liga (Belarus)
Beira Mar :: Segunda Liga (Portugal)

Wink


RE: Sports scraper - zag - 2015-01-05

Excellent! Nice work to all the new users, its a community based site so all the data needs to be updated by somebody.

Currently I am getting players from a 3rd party API that I paid for 3 months access. Hopefully we can update them in the future to correct any mistakes.

I'll add some more leagues at some point.

I've added some motorsport stuff if anyone wants to test it out and give some feedback. Its already getting difficult to cater for different sports using one screen!

http://www.thesportsdb.com/team/Ferrari

Excuse the terrible artwork, you can overwrite my attempt Wink


RE: Sports scraper - zag - 2015-01-05

I've started a thread on Fanart.tv to support the new artwork types in high quality. There are a number of members who have awesome graphic skills over there.

https://forum.fanart.tv/viewtopic.php?f=7&t=241&p=1598

Please post in that thread to lend your support.

While I'm at it, we now support Formula 1 and various other motorsports Smile

http://www.thesportsdb.com/team/Ferrari


RE: Sports scraper - bry - 2015-01-05

nice zag, i registered last night to try and get started on the NHL stuff.


RE: Sports scraper - bry - 2015-01-05

@zag, i posted this earlier but you may have missed it. You think you could find a way to scrape this info? https://www.google.com/calendar/render#j%7Csports


RE: Sports scraper - zag - 2015-01-05

NHL, NFL, NBA and Formula 1/E teams all added Wink

I'll have to look into fixture data sources as its different for each sport and I need something that's going to be reliable for years to come. Anything in XML. JSON or CSV format is very useful.

For now I'll concentrate on the team editing and once people get to a point with info added I will look further into individual events and schedules.

UK Soccer historical matches are already done. And that alone was 48,000 matches!! Big Grin


RE: Sports scraper - enen92 - 2015-01-05

Notice an error with the teams having ' on the name. Example:

http://www.thesportsdb.com/team/134779

M’gladbach => (Borussia M’gladbach)

Cheers


RE: Sports scraper - bry - 2015-01-05

@zag - this could work well - http://www.hockey-reference.com/leagues/NHL_1918.html they provide CSV all the way back to 1918


RE: Sports scraper - bry - 2015-01-05

actually - this should help out quite a bit. http://www.sports-reference.com/


RE: Sports scraper - Hazmat - 2015-01-05

Like what you guys are doing here! I cruised over here from fanart.tv(just a normal member) and posted my support and thoughts over there on the thread you linked zag. Would like to see cycling implemented in the future if possible. Big Grin


RE: Sports scraper - enen92 - 2015-01-06

So I contacted the getyourfixes team (former wiziwig) to check for a possibility for them to provide an API. The site is this one: http://www.getyourfixtures.com/

That's their answer:

"Thanks for the contact. We're currently still very busy with working on our website to improve it even further, so we don't have time yet to work on addons or other applications. Please remind us next month as we hope to be ready then for more features."

So not a yes and not a no, but definetly there's some room there for colaboration I guess.

cheers


RE: Sports scraper - zag - 2015-01-07

Thanks, it seems its quite hard to get free reliable data sources.

But I have managed to import Major European Soccer League fixtures and results. I'll keep on importing but its a tough job with so many leagues.

I've also added upcoming Formula 1 and Formula E races for this year from Ergast Wink

Example
http://www.thesportsdb.com/team/mclaren

Image

Vroom... Vroom!


RE: Sports scraper - Ovokx - 2015-01-07

This is getting big! Big Grin


RE: Sports scraper - el_Paraguayo - 2015-01-07

You may or may not be aware that I've been developing the BBC Live Football Scores service. It works by using a module I wrote that scrapes the BBC website for live scores, league tables (including last results) and could probably updated to do fixtures too.

I'd be very happy to assist if there's any desire to incorporate any of this functionality into anything that's developed as a result of this thread as everything here looks far more slick than my offering!!


RE: Sports scraper - zag - 2015-01-08

Thanks I posted in the thread, and had already seen your work. Infact it was one of the reasons I got started on this.

Lots more progress today on the site getting an automated feed for soccer results and fixtures. Most should be filled out now.

Thanks to all users contributing, keep the artwork high quality if you can and keep adding that data!

I've deleted the minor leagues for now as it was getting complicated but the teams still exist and should be filled out.

Once all the teams are in a good state, I'll start on the JSON API and Event pages Wink