Kodi Community Forum

Full Version: EPGimport (XMLTV)
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
The import of the XMLTV EPG from rytec sources serious problems on the servers.
KODI will try to import the files every minute. Same IP, same file request for import a minute appart.
This causes a severe overload of our servers. Some examples:

Code:
85.245.70.103 - - [01/Apr/2015:18:27:28 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:28:30 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:28:30 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:28:53 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:29:13 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:29:30 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:29:44 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:46 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:47 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:47 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:49 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:49 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:49 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:51 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:51 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:51 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:52 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:53 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:53 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:55 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:55 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:55 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:57 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:57 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:58 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:02 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:02 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:02 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:04 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:04 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:04 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:07 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:07 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:07 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"

Unless you clean up your software and perform one download a day (the files are only updated once a day) we will start blocking everything from Kodi.

Willy

PS: this file does not exist anymore at the moment. Due to the severe problems with this file we removed it.
Results from a morning blocking of Kodi requesting EPG

114698 IP's blocked due to surplus requests. Stop this nonsense pls.
We ask that you limit your software to downloading each file only once a day. And not retry every minute. Not even retries when not successful.

Clean up your act.

Willy
Curious question, but what plugin is downloading from your server?
EPGimport,
XMLTV import

I do not know how this is called in Kodi.
I only know the referer:

Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b

It is not only the raspberry version, but also any other operating system version.

Willy
I think it comes from this:


Kodi media center (formerly known as XBMC)

http://kodi.wiki/view/Advancedsettings.xml


<epg>
<lingertime>1440</lingertime> <!-- keep X minutes of past epg data (default: 24h) -->
<updatecheckinterval>300</updatecheckinterval> <!-- check if tables need to be updated every X minutes -->
<lingercleanupintervaltime>900</cleanupinterval> <!-- remove old entries from the EPG every X minutes -->
<activetagcheckinterval>60</activetagcheckinterval> <!-- check for updated active tags every X minute -->
<retryinterruptedupdateinterval>30</retryinterruptedupdateinterval> <!-- retry an interrupted epg update after X seconds -->
<updateemptytagsinterval>60</updateemptytagsinterval> <!-- override user selectable EPG update interval (minutes) for empty EPG tags -->
<displayupdatepopup>true</displayupdatepopup> <!-- display a progress popup while updating EPG data from clients -->
<displayincrementalupdatepopup>false</displayincrementalupdatepopup> <!-- also display a progress popup while doing incremental EPG updates -->
</epg>

Willy
To my knowledge doesn't request any EPG information from any web based source. It only requests it from "local" PVR sources (like NextPVR, ArgusTV, Windows Media Center, etc). So the Advance Settings stuff you pointed to doesn't really mean anything in this context. The trick here is to figure out what add-on is doing this so that you can get in contact with the author of the add-on (as it is almost certainly not a core Kodi add-on). Can I start with a more basic question? What is the name of your service (the one getting pounded by these requests)? I tried doing some Google searches with EPGimport and XMLTVimport and Kodi and can't really narrow it down without knowing the place the add-on is trying to communicate with.
I do not know anything about Kodi. The EPGschedules are made for engima2 receivers.
Our website is: http://forums.openpli.org/forum/52-en-ry...g-support/

I cannot give the download websites on an open forum, since these are under attack.

I will try to send you the info by PM.

Willy
I was looking for some PVR info for my python code and this was just HILARIOUS to read!!  Rofl