2012-12-05, 04:53
(2012-12-04, 08:57)ajay Wrote:(2012-12-04, 07:17)lazyguy Wrote: Ajay,
thanks for the initiative to update this plugin. I don't know how you plan to handle the myriad of possibilities that site can throw at you while scraping it. They do not seem to follow any general rule. Sometimes the links take you to another domain, and other times it refers to pages on the same domain with the video itself. Sometimes the movie parts are on different pages, and other times they are on the same page. Some movies have play lists, some don't. Some do autoplay while others don't. And then throw in the different hosters and you have got so many possible scraping scenarios. Anyhow, kudos on your effort and let us know if you need some coding help. Some suggestions, if I may,
1. Use urlresolver if possible for major sites like youtube, dailymotion etc. That module gets updated frequently and have lot of support behind it.
2. If possible keep a flat file of the list of movies with links on the local machine. There is no point scarping the whole page everytime.
3. Keep the structure as simple as possible, so that less enlightened folks like us can perform occassional touchup coding, if you are OK with it.
Thanks.
Thanks for sharing valuable inputs. I am rewriting complete addon using in house framework: Turtle. It is now very simple to understand. I have already update Turtle to use UrlResolver for URLs that are not understood to Snapper module of turtle. I keep youtube and daily motion streaming always up in most of the cases.
I have also use meta handler module to retrieve movie images in this new version. Please let me know if you are interested in making this addon with me.
Thanks Ajay for your reply. I shall try my best to help you out as much my time permits. Can you please send me a brief description how the turtle framework works? You can send me the info through pm. I tried to browse the repo, but saw many old files and was confused.
Thanks.