An open letter to responsible script guys at XBMC
#16
Any ideas of how to approach this flagging of non working scripts are taken into consideration. Sorry if I sound negative, but have been pondering different scenarios/ideas for quite some while now, and belive me I really want this incorporated aswell.

But keep the constructive criticism flowing and we might end up with a descent solution. Gotten some twists to an idea already Smile
Reply
#17
Wonderfull Smile A good discussion is always welcome and was my idea for this post. And to all those hard working xbmc dedicated supporters your work
is very much apriciated !

Now back to adressing the issue at hand, "how to keep up with what scripts are good/bad"......

I have another idea that i bellive is atleast simple for both users and developers.
What if there was a button the user could push in xbmc itself, that reports the plugin as either "working", "buggy" or "not working". Together with this info the xbmc version, plattform type/version, and maybe some other usefull info is sent to a central server. From all the data that comes in there is a webpage listing all the plugins reported with all the different flags from each user. Then everything would be automatic and no user interaction would be required to maintain a web list wich will be updated at all time from all the thousends of reports coming in.

Then from this list it would be easy to automaticly rate plugins from percentages of reported working non working. Offcourse there will be some
"wrong" reports coming in due to other user errors but no matter what if a plugin is reported on that page with a sucess rate of 90% based on statistics from say 3000 people i would my self bellive that plugin to be good.

If another plugin had an sucess rate of 10% based on reports from 3000 user i would not bother to download/install it.

Ofcourse someone could then once a week check this list and remove those with least sucess rate during a given period.


Is this duable ?
Reply
#18
I've noticed that people are more likely to only say something whenever something is going wrong. I'm not sure how many people would go out and press the hypothetical "it is working" button. However, whenever it isn't working, or something is wrong with the xbmc version or network, people would be mashing the "not working" button.

Submissions would definitely need to be limited based on IP or some other means so that the percentage wouldn't be incorrectly inflated.

I'm not sure how to get people to submit positive results as opposed to only, or mostly, negative.

Also, what about partially working plugins? i.e. megavideo links work, but supernova has quit working.
When posting about a problem please submit a debug log to give you the best chance at getting an answer. It's easy, painless, and helps provide necessary information.
Reply
#19
One way to make sure users reported also working plugins
would be to nag them with a popup for all plugins that lacks a report.
im sure there is some way to track what plugins a user has reported on or not.
Just pop up to simple buttons for the user, he/she has to select one of them Wink
Reply
#20
re # of false reports...

Perhaps, in these cases its not necessarily the details of the reports, but the quantity.

for example, if plugin "A" has reported ~100 reports and plugin "B" has reported ~10000 reports, then aside from popularity skewing, that could point to a serious problem or problems with plugin "B".

It would also highlight what exactly plugins people are using/trying to use day to day and provide a good starting point for anyone who does have the time/energy to look through reports to identify the root problems and possible solutions.
Reply
#21
It's an approach, balance no of downloads against no of "non working" reports. Some things arise to my mind at once.

What to do when the author updates the addon?
- reset all values to zero?
- keep downloads and reset reports?

If we "nag" people to vote with a popup, wouldn't you get annoyed that every time you used a plugin there would be a popup.. Think in 8 out of 10 cases most users would just click first available button to get rid of the popup.

Feels kind of pointless to have that, since you would need to try the addon a few times before reporting. But we could always let the user start the addon for 10 times, then start doing the popup.

This will also require either 1: rewrite of xbmc to make xbmc do the popup or 2: have the addons author to implement that check (of course we could make it into a module that you just import to any plugin/script)

For this to be parsable by an automated script, the output would have to be really strict. This isn't an easy task, since we would have tons of revisions of xbmc (eg: you can compile it yourself for every revision)

Besides, a few times errors in addons isn't even the addons fault, sometimes something in xbmc is borked.
Reply
#22
When it comes to self compiled versions of xbmc i bellive the best thing there would just be to put them in a "selfcompiled category". Most user will however use stable builds so statistics against stable build would be important.

nagging with a popup after says 10-15 runs is a good idea in my mind. if the plugin doesent work there will probably not come in any reports, however if it works and the users actually uses the script a likely report would then be "working"
This would again lead to that scripts wich doesent work will have very few reports (most likely) because the user never ran that script 15 times.

About versions of the scripts:
I bellive keeping everything is the best idea. When a script goes up to a new version it will be added above the old version. So the new version starts of with completely blank sheets again. This is important because we would like to keep a script that has good stats, regardless of the version.
Reply
#23
I wouldn't care to have any type of non-user initiated nag.

What I would find useful as a user would be a single menu entry on the script/plugin/etc context menu that says something to the effect that this item doesn't work for me and when clicked pops up a more detailed box which can then be submitted along with any useful information prepopulated (version/architecture/log/etc) to the author/QA/interested parties.
Reply
#24
Well i know most users dont like popup that much, but i bellive sometimes
one needs to nag the casual user. If not im sure that no one will ever find that button/option Wink We have to remember that the goal itself sometimes rectifies the means.
Reply
#25
I don't understand why are you so bothered about users.. not many of them commented on this thread so far nor complained about not working add-ons in general. If someone wants an add-on to work properly - he'll find a way (via SVN installer update option?)
Don't get me wrong, but if you all feel like you need some kind of 'tool' to verify/update plugins/scripts - do it your way. Everyone else who's interested will adjust accordingly.

Regards,
pX
Reply
#26
pajretX no offense but i think you did not read my initial post.
My point was that as of now plugins is not for the mainstream users since
there are so many broken ones.

The idea is to get a working base of plugins for everyone to use.

I bellive team XBMC cares alott for their users, not only thee geeks in these forums. The really big audience for xbmc is the casual non geeky users. this thread was about what plans team xbmc has for their plugin function...
Reply
#27
pajretX -- why would one NOT be bothered about users? Going to this forum, registering for an account, then figuring out how to 'properly report' bugs -- give me a break. Most people aren't even going to remotely understand that as the process. You want to make XBMC a better user experience, right?
Reply
#28
The-Boxhead - I have read it. However, the thread has transformed slightly into 'lets get users to do that or that' - maybe they don't want that? Not many said they do. That's what I meant.

w3___:I think it's just the way I wrote it. I did not mean 'screw users'. It was more like 'there is enough of people that know what they are doing, who can help and support the project' kind of post. - My bad.

Regards,
pX
Reply
#29
Twist of the popup nag.. What if it would show when ending the script ? Eg: "Did this script work for you?"
Reply
#30
blittan Wrote:Twist of the popup nag.. What if it would show when ending the script ? Eg: "Did this script work for you?"

That would certainly be better than a popup, but what if it throws an error before the script has a chance to open up? I've had plugins or scripts just say something like:
"error in default.py" and refuse to go any further.
When posting about a problem please submit a debug log to give you the best chance at getting an answer. It's easy, painless, and helps provide necessary information.
Reply

Logout Mark Read Team Forum Stats Members Help
An open letter to responsible script guys at XBMC0