Posts: 22
Joined: Jan 2017
Reputation:
3
alright so quick update, I've now got the menus/data scraping working but the getting the video is turning out to be a bit trickier, should be done(albeit in a slightly hacky spaghetti way) in a week or two depending on my work schedule.
if anyone knows how to get the video manifest easy feel free to share because they've changed it and it's turning out to be a bit annoying to fix haha
Posts: 22
Joined: Jan 2017
Reputation:
3
Yeah I haven't gotten around to looking at yet, been pretty tied up at work. but from memory the publishpoint doesn't seem to like any of the UAs i've tried so i think there is something else that is broken but I know getting the whole desktop manifest is possible because a third party downloader can get it all the available bit rates fine but unfortunately it isn't open source so I can't understand how it's getting it
Posts: 22
Joined: Jan 2017
Reputation:
3
2017-03-12, 14:40
(This post was last modified: 2017-03-13, 02:06 by mayofreak.)
ok if you go to my fork of it there is a working version but it's super hacky, and sub categories is pretty broken but working to the point where you can play videos, I'm not doing a pull request though because it's more just to make sure it's working
to do:
fix get_parsed_subs
fix get_parsed_vids(more minor issues)
reintergrate thumbnails, dates and descriptions
higher bitrates
fix all the terrible spaghetti workarounds i tried and left in there
possibly in the future get the manifest with selectable bitrates rather than variable
also while testing some uas with access to higher bitrates i found kodi couldn't open any hd streams kept getting 'ERROR: CVideoPlayer::OpenDemuxStream - Error creating demuxer' might just be my build of kodi though will test out later
Posts: 55
Joined: Mar 2016
Reputation:
7
mayofreak,
Decent start, but I can't help but wonder if it's time to get rid of the scraping altogether. Just doesn't seem to be deterministic enough. Looking at the APIs, it would likely be pretty easy to do. I think if I crack a beer or three, I could hammer this out in an hour or two and have it back to the way it was before the site update, at least.
Posts: 22
Joined: Jan 2017
Reputation:
3
yeah I was trying to think about how it would be possible to get all sub categories because the only thing in common between pages that have different types of sub categories like seasons, collections, shows and the like was the url contained /category/ rather than video which would garner even less desirable results than my miserly efforts haha.
I don't know a lot about api calls other than building a few movie suggesting bots from tmdbs api but would be happy to help, I really only did this because I enjoy UFC and wanted to learn a bit of python(literally never used it before haha)
Posts: 22
Joined: Jan 2017
Reputation:
3
aweseome! works on android too
I might have a bit of a tinker around(for myself) see if I can do anything else
Posts: 22
Joined: Jan 2017
Reputation:
3
I just submitted a pull requests for 720 streams, I think xbox one is the only platform that supports 1080 and I don't own one of those so this will have to do for the moment