Release TheMovieDB movie scraper - PYTHON version
#99
im getting nothing but errors when trying to scrape with the python scraper.. seems largely imdb related
Quote:2021-03-17 15:20:49.741 T:5331 ERROR <general>: EXCEPTION Thrown (PythonToCppException) : -->Python callback/script returned the following error<--
- NOTE: IGNORING THIS CAN LEAD TO MEMORY LEAKS!
Error Type: <class 'socket.timeout'>
Error Contents: The read operation timed out
Traceback (most recent call last):
File "/storage/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py", line 175, in <module>
run()
File "/storage/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py", line 164, in run
enddir = not get_details(parse_lookup_string(params["url"]), params['handle'], settings)
File "/storage/.kodi/addons/metadata.themoviedb.org.python/python/scraper.py", line 102, in get_details
imdbinfo = get_imdb_details(details['uniqueids'])
File "/storage/.kodi/addons/metadata.themoviedb.org.python/python/lib/tmdbscraper/imdbratings.py", line 34, in get_details
votes, rating, top250 = _get_ratinginfo(imdb_id)
File "/storage/.kodi/addons/metadata.themoviedb.org.python/python/lib/tmdbscraper/imdbratings.py", line 38, in _get_ratinginfo
response = api_utils.load_info(IMDB_RATINGS_URL.format(imdb_id), default = '', resp_type='text')
File "/storage/.kodi/addons/metadata.themoviedb.org.python/python/lib/tmdbscraper/api_utils.py", line 62, in load_info
response = urlopen(req)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
File "/usr/lib/python3.8/urllib/request.py", line 525, in open
File "/usr/lib/python3.8/urllib/request.py", line 542, in _open
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
File "/usr/lib/python3.8/urllib/request.py", line 1397, in https_open
File "/usr/lib/python3.8/urllib/request.py", line 1358, in do_open
File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
File "/usr/lib/python3.8/http/client.py", line 307, in begin
File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
File "/usr/lib/python3.8/socket.py", line 669, in readinto
File "/usr/lib/python3.8/ssl.py", line 1241, in recv_into
File "/usr/lib/python3.8/ssl.py", line 1099, in read
socket.timeout: The read operation timed out
-->End of Python script error report<--
just non stop errors
Longer log extract https://cloud.dimspace.xyz/s/W6mS4eAdcZ2FAwQ

and a lot of locking up as well, and crashing my device during scrape. summat not right (using coreelec fwiw)
Reply


Messages In This Thread
RE: TheMovieDB movie scraper - PYTHON version - by dm21912 - 2021-03-17, 17:28


Logout Mark Read Team Forum Stats Members Help
TheMovieDB movie scraper - PYTHON version0
This forum uses Lukasz Tkacz MyBB addons.