EPGimport (XMLTV)
doglover
Junior Member
Posts: 12
#1
2015-04-02, 10:37
The import of the XMLTV EPG from rytec sources serious problems on the servers.
KODI will try to import the files every minute. Same IP, same file request for import a minute appart.
This causes a severe overload of our servers. Some examples:

Code:
85.245.70.103 - - [01/Apr/2015:18:27:28 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:28:30 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:28:30 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:28:53 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:29:13 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:29:30 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:29:44 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:46 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:47 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:47 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:49 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:49 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:49 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:51 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:51 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:34:51 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:52 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:53 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:53 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:55 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:55 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:55 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:57 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:57 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:39:58 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:02 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:02 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:02 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:04 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:04 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:04 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:07 +0200] "HEAD /rytecxmltvportugal.gz HTTP/1.1" 404 - "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:07 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"
85.245.70.103 - - [01/Apr/2015:18:45:07 +0200] "GET /rytecxmltvportugal.gz HTTP/1.1" 404 306 "-" "Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b"

Unless you clean up your software and perform one download a day (the files are only updated once a day) we will start blocking everything from Kodi.

Willy

PS: this file does not exist anymore at the moment. Due to the severe problems with this file we removed it.
Find
Reply
doglover
Junior Member
Posts: 12
#2
2015-04-02, 14:45
Results from a morning blocking of Kodi requesting EPG

114698 IP's blocked due to surplus requests. Stop this nonsense pls.
We ask that you limit your software to downloading each file only once a day. And not retry every minute. Not even retries when not successful.

Clean up your act.

Willy
Find
Reply
TheGame1986
Fan
Posts: 419
#3
2015-04-02, 14:51
Curious question, but what plugin is downloading from your server?
Find
Reply
doglover
Junior Member
Posts: 12
#4
2015-04-02, 14:57
EPGimport,
XMLTV import

I do not know how this is called in Kodi.
I only know the referer:

Kodi/15.0-ALPHA2 (X11; Linux armv6l) OpenELEC/5.0 HW_RaspberryPi/1.0 App_Bitness/32 Version/15.0-ALPHA2-Git:ada3a4b

It is not only the raspberry version, but also any other operating system version.

Willy
Find
Reply
doglover
Junior Member
Posts: 12
#5
2015-04-02, 15:04
I think it comes from this:


Kodi media center (formerly known as XBMC)

http://kodi.wiki/view/Advancedsettings.xml


<epg>
<lingertime>1440</lingertime> <!-- keep X minutes of past epg data (default: 24h) -->
<updatecheckinterval>300</updatecheckinterval> <!-- check if tables need to be updated every X minutes -->
<lingercleanupintervaltime>900</cleanupinterval> <!-- remove old entries from the EPG every X minutes -->
<activetagcheckinterval>60</activetagcheckinterval> <!-- check for updated active tags every X minute -->
<retryinterruptedupdateinterval>30</retryinterruptedupdateinterval> <!-- retry an interrupted epg update after X seconds -->
<updateemptytagsinterval>60</updateemptytagsinterval> <!-- override user selectable EPG update interval (minutes) for empty EPG tags -->
<displayupdatepopup>true</displayupdatepopup> <!-- display a progress popup while updating EPG data from clients -->
<displayincrementalupdatepopup>false</displayincrementalupdatepopup> <!-- also display a progress popup while doing incremental EPG updates -->
</epg>

Willy
Find
Reply
pkscout
Team-Kodi Member
Posts: 3,448
#6
2015-04-03, 03:37
To my knowledge doesn't request any EPG information from any web based source. It only requests it from "local" PVR sources (like NextPVR, ArgusTV, Windows Media Center, etc). So the Advance Settings stuff you pointed to doesn't really mean anything in this context. The trick here is to figure out what add-on is doing this so that you can get in contact with the author of the add-on (as it is almost certainly not a core Kodi add-on). Can I start with a more basic question? What is the name of your service (the one getting pounded by these requests)? I tried doing some Google searches with EPGimport and XMLTVimport and Kodi and can't really narrow it down without knowing the place the add-on is trying to communicate with.
Kodi Addons | Estuary mod | Github Projects
Find
Reply
doglover
Junior Member
Posts: 12
#7
2015-04-03, 09:32
I do not know anything about Kodi. The EPGschedules are made for engima2 receivers.
Our website is: http://forums.openpli.org/forum/52-en-ry...g-support/

I cannot give the download websites on an open forum, since these are under attack.

I will try to send you the info by PM.

Willy
Find
Reply
snoopyjoe
Senior Member
Posts: 285
#8
2018-04-15, 09:23
I was looking for some PVR info for my python code and this was just HILARIOUS to read!!  Rofl
Find
Reply

Home
Search
Help
Logout Mark Read Team Forum Stats Members Help
EPGimport (XMLTV)0