[KGbcguy]

TheAudioDB is not working at all for me, Currently using " The Internet Music Video Database" and it is still running into huge issues miss-labeling songs completely " Pink Floyd - Louder Than Words " scrapes as " Cold War Kids - Louder than ever " Won't let me manually change to proper song. on that note I ma using nightly build 17

[docwra]

TADB will finally be back tomorrow

[docwra]

Just for info, if anyone wants to get the square Music Video images working in Esturary, there is a PR here detailing the code changes needed.

It probably won't be accepted into the defaults but its there if anyone needs it.

https://github.com/xbmc/xbmc/pull/11811

[ferent]

I'm trying to get info from some videos of Aerosmith, but the scraper can't do it. I've checked the logs, and I think is due the strAlbum is null.

Here you have some logs:

01:56:15.860 T:140421917567104 DEBUG: GetMusicVideoId (/media/Mediacenter/Videclips/VCLIPS/Aerosmith - Crazy.mpg), query = select idMVideo from musicvideo where idFile=3168
01:56:15.869 T:140421917567104 DEBUG: VideoInfoScanner: No NFO file found. Using title search for '/media/Mediacenter/Videclips/VCLIPS/Aerosmith - Crazy.mpg'
01:56:15.869 T:140421917567104 DEBUG: DialogProgress::Open called
01:56:15.869 T:140421917567104 DEBUG: ------ Window Init (DialogConfirm.xml) ------
01:56:16.290 T:140420208523008 DEBUG: Thread VideoInfoDownloader start, auto delete: false
01:56:16.290 T:140420208523008 DEBUG: FindMovie: Searching for 'Aerosmith - Crazy' using TheAudioDb.com for Music Videos scraper (path: '/storage/.kodi/addons/metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.3.2')
01:56:16.308 T:140420208523008 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&amp;t=Crazy</url>
01:56:16.309 T:140420208523008 DEBUG: CurlFile::Open(0x63bf2a0) http://www.theaudiodb.com/api/v1/json/18...th&t=Crazy
01:56:16.312 T:140420208523008 INFO: easy_acquire - Created session to http://www.theaudiodb.com
01:56:16.478 T:140420208523008 DEBUG: Get: Using content of "http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&t=Crazy" as binary or text with "UTF-8" charset
01:56:16.481 T:140420208523008 DEBUG: scraper: GetSearchResults returned <results sorted="yes"></results>
01:56:16.481 T:140420208523008 DEBUG: FindMovie: Searching for 'Aerosmith - Crazy' using TheAudioDb.com for Music Videos scraper (path: '/storage/.kodi/addons/metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.3.2')
01:56:16.482 T:140420208523008 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&amp;t=Crazy</url>
01:56:16.482 T:140420208523008 DEBUG: CurlFile::Open(0x63bf2a0) http://www.theaudiodb.com/api/v1/json/18...th&t=Crazy
01:56:16.511 T:140420208523008 DEBUG: Get: Using content of "http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&t=Crazy" as binary or text with "UTF-8" charset
01:56:16.515 T:140420208523008 DEBUG: scraper: GetSearchResults returned <results sorted="yes"></results>
01:56:16.515 T:140420208523008 DEBUG: Thread VideoInfoDownloader 140420208523008 terminating
01:56:16.540 T:140421917567104 DEBUG: ------ Window Init (DialogKeyboard.xml) ------
01:56:16.544 T:140421917562624 DEBUG: CAnnouncementManager - Announcement: OnInputRequested from xbmc
01:56:16.545 T:140421917562624 DEBUG: GOT ANNOUNCEMENT, type: 128, from xbmc, message OnInputRequested
01:56:16.567 T:140421416548096 DEBUG: Skin Helper Service --> Kodi_Monitor: sender xbmc - method: Input.OnInputRequested - data: {"title":"Enter the movie name","type":"keyboard","value":"Aerosmith - Crazy.mpg"}
01:56:16.602 T:140421095204608 DEBUG: Skin Helper Widgets --> Kodi_Monitor: sender xbmc - method: Input.OnInputRequested - data: {"title":"Enter the movie name","type":"keyboard","value":"Aerosmith - Crazy.mpg"}

Thanks.

[docwra]

You can test each API call as per the log

Code:

http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&t=Crazy

Does not work

But

Code:

http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&t=Crazy

Does work, So it looks like its badly tagged to me in some way adding an extra "amp;t" for some reason.

EDIT: oh no thats probably just the internal scraper stuff. It looks OK to me actually.

[ferent]

Sorry, I don't see what you mean, what is the internal scraper? The point is that if read the log, at the end, it says:

01:56:16.567 T:140421416548096 DEBUG: Skin Helper Service --> Kodi_Monitor: sender xbmc - method: Input.OnInputRequested - data: {"title":"Enter the movie name","type":"keyboard","value":"Aerosmith - Crazy.mpg"}

what means that the scraper is calling to the Skin helper Service because is not able to find the video, but the video info is here: http://www.theaudiodb.com/api/v1/json/18...th&t=Crazy

so maybe what I think is that it returns this error because there is no strAlbum info in the json ?? is the only difference I found between a music video the scraper found and one that doesn't....

Maybe there is another reason, but I can't see it in the output log.

Could you try to rename one of your music video to Aerosmith - Crazy.mp4 and try to find it using the scraper, please?

[roura97311]

Have a look through this whole thread, i'm sure I remember someone getting apostrophes to work.

Maybe try a double apostrophe in the filename?

In the mean time I added it to my repo

EDIT: site is now banned unfortunately

Hello,
I encounter problems when searching for music video with artists who have apostrophes like these
Keen'v or Shy'm. The scrapper does not find it

[docwra]

Could you try to rename one of your music video to Aerosmith - Crazy.mp4 and try to find it using the scraper, please?

Just tested and I have the same issue with that particular song, I'm really not sure whats wrong.

API Call
http://www.theaudiodb.com/api/v1/json/18...th&t=Crazy

09:58:19.513 T:32448 NOTICE: VideoInfoScanner: Starting scan ..
09:58:19.515 T:33448 DEBUG: CAnnouncementManager - Announcement: OnScanStarted from xbmc
09:58:19.516 T:33448 DEBUG: GOT ANNOUNCEMENT, type: 16, from xbmc, message OnScanStarted
09:58:19.517 T:32448 DEBUG: VideoInfoScanner: Scanning dir 'C:\Encode\Mvids\2\' as not in the database
09:58:19.519 T:32448 DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'C:\Encode\Mvids\2\Aerosmith - Crazy.mp4'
09:58:19.519 T:32448 DEBUG: ADDON::CScraper::FindMovie: Searching for 'Aerosmith - Crazy' using TheAudioDb.com for Music Videos scraper (path: 'C:\Users\user\AppData\Roaming\Kodi\addons\metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.3.2')
09:58:19.526 T:32448 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&amp;t=Crazy</url>
09:58:19.527 T:32448 DEBUG: CurlFile::Open(1120CFD8) http://www.theaudiodb.com/api/v1/json/18...th&t=Crazy
09:58:19.527 T:32448 INFO: XCURL:llLibCurlGlobal::easy_aquire - Created session to http://www.theaudiodb.com
09:58:19.582 T:32448 DEBUG: CScraperUrl::Get: Using content of "http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&t=Crazy" as binary or text with "UTF-8" charset
09:58:19.582 T:32448 DEBUG: scraper: GetSearchResults returned <results sorted="yes"></results>
09:58:19.582 T:32448 DEBUG: ADDON::CScraper::FindMovie: Searching for 'Aerosmith - Crazy' using TheAudioDb.com for Music Videos scraper (path: 'C:\Users\user\AppData\Roaming\Kodi\addons\metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.3.2')
09:58:19.583 T:32448 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&amp;t=Crazy</url>
09:58:19.583 T:32448 DEBUG: CurlFile::Open(1120CFD8) http://www.theaudiodb.com/api/v1/json/18...th&t=Crazy
09:58:19.616 T:32448 DEBUG: CScraperUrl::Get: Using content of "http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Aerosmith&t=Crazy" as binary or text with "UTF-8" charset
09:58:19.616 T:32448 DEBUG: scraper: GetSearchResults returned <results sorted="yes"></results>
09:58:19.616 T:32448 WARNING: No information found for item 'C:\Encode\Mvids\2\Aerosmith - Crazy.mp4', it won't be added to the library.

And here is one that does work. Can anyone spot the difference?

API Call
http://www.theaudiodb.com/api/v1/json/18...y%20Wasted

10:07:25.382 T:32644 DEBUG: CVideoDatabase::GetMusicVideoId (C:\Encode\Mvids\INXS - Elegantly Wasted.mp4), query = select idMVideo from musicvideo where idFile=1155
10:07:25.382 T:32644 DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'C:\Encode\Mvids\INXS - Elegantly Wasted.mp4'
10:07:25.382 T:32644 DEBUG: ADDON::CScraper::FindMovie: Searching for 'INXS - Elegantly Wasted' using TheAudioDb.com for Music Videos scraper (path: 'C:\Users\gareth\AppData\Roaming\Kodi\addons\metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.3.2')
10:07:25.386 T:32644 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=INXS&amp;t=Elegantly%20Wasted</url>
10:07:25.386 T:32644 DEBUG: CurlFile::Open(1120D6B0) http://www.theaudiodb.com/api/v1/json/18...y%20Wasted
10:07:25.399 T:32644 DEBUG: CScraperUrl::Get: Using content of "http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=INXS&t=Elegantly%20Wasted" as binary or text with "UTF-8" charset
10:07:25.399 T:32644 DEBUG: scraper: GetSearchResults returned <results sorted="yes"><entity><title>INXS - Elegantly Wasted [Elegantly Wasted]</title><url cache="tadb-32775336.json">http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/track.php?h=32775336</url></entity></results>
10:07:25.399 T:32644 DEBUG: VideoInfoScanner: Fetching url 'http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/track.php?h=32775336' using TheAudioDb.com for Music Videos scraper (content: 'musicvideos')
10:07:25.399 T:32644 DEBUG: ADDON::CScraper::GetVideoDetails: Reading movie 'http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/track.php?h=32775336' using TheAudioDb.com for Music Videos scraper (file: 'C:\Users\gareth\AppData\Roaming\Kodi\addons\metadata.musicvideos.theaudiodb.com', content: 'musicvideos', version: '1.3.2')
10:07:25.399 T:32644 DEBUG: CurlFile::Open(1120D6B0) http://www.theaudiodb.com/api/v1/json/18...h=32775336
10:07:25.423 T:32644 DEBUG: CScraperUrl::Get: Using content of "http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/track.php?h=32775336" as binary or text with "UTF-8" charset
10:07:25.427 T:32644 DEBUG: scraper: GetDetails returned <details><title>Elegantly Wasted</title><artist>INXS</artist><album>Elegantly Wasted</album><plot></plot><director>Walter S. Stern</director><studio></studio><chain function="GetTADBAlbumGenresByMBID">88c235fc-9d12-3109-9d98-9b76d86c359b</chain><chain function="GetTADBAlbumDateByMBID">88c235fc-9d12-3109-9d98-9b76d86c359b</chain><chain function="GetTADBAlbumThumbsByMBID">88c235fc-9d12-3109-9d98-9b76d86c359b</chain></details>
10:07:25.427 T:32644 DEBUG: scraper: GetTADBAlbumGenresByMBID returned <details><url function="ParseTADBAlbumGenres" cache="tadb-88c235fc-9d12-3109-9d98-9b76d86c359b-album.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/album-mb.php?i=88c235fc-9d12-3109-9d98-9b76d86c359b</url></details>
10:07:25.427 T:32644 DEBUG: CurlFile::Open(1120D6B0) http://www.theaudiodb.com/api/v1/json/58...76d86c359b
10:07:25.440 T:32644 DEBUG: CScraperUrl::Get: Using content of "http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/album-mb.php?i=88c235fc-9d12-3109-9d98-9b76d86c359b" as binary or text with "UTF-8" charset
10:07:25.443 T:32644 DEBUG: scraper: ParseTADBAlbumGenres returned <details><genre>Rock</genre></details>
10:07:25.443 T:32644 DEBUG: scraper: GetTADBAlbumDateByMBID returned <details><url function="ParseTADBAlbumDate" cache="tadb-88c235fc-9d12-3109-9d98-9b76d86c359b-album.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/album-mb.php?i=88c235fc-9d12-3109-9d98-9b76d86c359b</url></details>
10:07:25.444 T:32644 DEBUG: scraper: ParseTADBAlbumDate returned <details><year>1997</year></details>
10:07:25.444 T:32644 DEBUG: scraper: GetTADBAlbumThumbsByMBID returned <details><url function="ParseTADBAlbumThumbs" cache="tadb-88c235fc-9d12-3109-9d98-9b76d86c359b-album.json">http://www.theaudiodb.com/api/v1/json/58424d43204d6564696120/album-mb.php?i=88c235fc-9d12-3109-9d98-9b76d86c359b</url></details>
10:07:25.444 T:32644 DEBUG: scraper: ParseTADBAlbumThumbs returned <details><thumb preview="http://www.theaudiodb.com/images/media/album/thumb/wvwyvx1341508865.jpg/preview">http://www.theaudiodb.com/images/media/album/thumb/wvwyvx1341508865.jpg</thumb></details>
10:07:25.445 T:32644 DEBUG: VideoInfoScanner: Adding new item to musicvideos:C:\Encode\Mvids\INXS - Elegantly Wasted.mp4

Maybe its the data returned in the json that is different in some way?

[ferent]

Reviewing the scraper code, there is this expression:
<expression repeat="yes" clear="yes" fixchars="1" noclean="1">idTrack":"([^"]*)","idAlbum":"([^"]*).*?"strTrack":"([^"]*)","strAlbum":"([^"]*)","strArtist":"([^"]*)</expression>

I'm not a developer, but it seems that it gets the video info only when it find all these tags:
- idTrack
- idAlbum
- strTrack
- strAlbum
- strArtist

As mentioned before, if you look at the json output of the Aerosmith song, the strAlbum is null, while in the other example you pasted is not.

To be honest, I don't know how important for the scraper is to match all this tags in the Json file, maybe it is to get the album fanart, which is not important to me, as what I want is to detect as much music videos as possible in my library.

This afternoon I will remove the strAlbum from that expression and see what happens.
BTW I think this scraper needs a bit of more love from the dev team, cause I think the apostrophe problem should be easily fixed as well adding any kind of RegExp in the code, and I think there are a lot of people using the Music Video feature in Kodi. Sadly I'm not a developer to fix it.

EDIT: I've added a new topic in the AudioDB forum asking them to fix the json issue.

[docwra]

Great research!

OK I have fixed TheAudioDB JSON response now, all album strings should be filled. I found about 2,000 tracks that must have been from the early days of the site. All fixed now.

EDIT: Tested and now it works

I think the scraper is working how it should (other than apostrophe's)

[DarkHelmet]

I have two tracks too that I cannot get to be scraped:

Prince - 1999.mp4
Phoenix - 1901.mp4

This is just a wild guess, but maybe the song title, a number in this case, gets misinterpreted as a year?

http://pastebin.com/9ePFzw52 log for the Prince title

http://pastebin.com/R1ckHtzX for the Phoenix title

[docwra]

I have two tracks too that I cannot get to be scraped:

Prince - 1999.mp4
Phoenix - 1901.mp4

This is just a wild guess, but maybe the song title, a number in this case, gets misinterpreted as a year?

http://pastebin.com/9ePFzw52 log for the Prince title

http://pastebin.com/R1ckHtzX for the Phoenix title

Yep looks like the track name is empty when sent to the TADB API.

I'm guessing the scraper regex is removing numbers for some reason.

[roura97311]

I do not understand why the request under kodi sends these:

11:23:51 T:248 DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://192.168.0.125/MVid/Shy'm - Tourne.mp4'
11:23:51 T:248 DEBUG: ADDON::CScraper::FindMovie: Searching for 'Shy'm - Tourne' using TheAudioDb.com for Music Videos scraper (path: 'C:\Users\lolo\AppData\Roaming\Kodi\addons\metadata.musicvideos.theaudiodb.com-master', content: 'musicvideos', version: '1.3.2')
11:23:51 T:248 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Shy\'m&amp;t=Tourne</url>
11:23:51 T:248 DEBUG: CurlFile::Open(12991D58) http://www.theaudiodb.com/api/v1/json/18...m&t=Tourne
11:23:51 T:248 INFO: XCURL:llLibCurlGlobal::easy_aquire - Created session to http://www.theaudiodb.com

While this works, how to avoid the apostrophes problem?

http://www.theaudiodb.com/api/v1/json/18...=Shy%27m&t=

[DarkHelmet]

I have two tracks too that I cannot get to be scraped:

Prince - 1999.mp4
Phoenix - 1901.mp4

This is just a wild guess, but maybe the song title, a number in this case, gets misinterpreted as a year?

http://pastebin.com/9ePFzw52 log for the Prince title

http://pastebin.com/R1ckHtzX for the Phoenix title

Yep looks like the track name is empty when sent to the TADB API.

I'm guessing the scraper regex is removing numbers for some reason.

Can you bring this to the right guy's attention or should I? I'd make a trac report then.

[DarkHelmet]

I do not understand why the request under kodi sends these:

11:23:51 T:248 DEBUG: VideoInfoScanner: No NFO file found. Using title search for 'smb://192.168.0.125/MVid/Shy'm - Tourne.mp4'
11:23:51 T:248 DEBUG: ADDON::CScraper::FindMovie: Searching for 'Shy'm - Tourne' using TheAudioDb.com for Music Videos scraper (path: 'C:\Users\lolo\AppData\Roaming\Kodi\addons\metadata.musicvideos.theaudiodb.com-master', content: 'musicvideos', version: '1.3.2')
11:23:51 T:248 DEBUG: scraper: CreateSearchUrl returned <url>http://www.theaudiodb.com/api/v1/json/18626d636d76696473706d/searchtrack.php?s=Shy\'m&amp;t=Tourne</url>
11:23:51 T:248 DEBUG: CurlFile::Open(12991D58) http://www.theaudiodb.com/api/v1/json/18...m&t=Tourne
11:23:51 T:248 INFO: XCURL:llLibCurlGlobal::easy_aquire - Created session to http://www.theaudiodb.com

While this works, how to avoid the apostrophes problem?

http://www.theaudiodb.com/api/v1/json/18...=Shy%27m&t=

You could try leaving the apostrophe away from the name and make Shy m out of it. I got "Guns N' Roses" tracks to work as "Guns N Roses". However Noel Gallagher's High Flying Birds fails whatever i do.