New GOTD Evaluation System « Giveaway of the Day Forums

Back to Giveaway of the Day

Giveaway of the Day Forums » General discussion

[sticky]

New GOTD Evaluation System

(63 posts) (28 voices)

Started 3 months ago by Giveaway of the Day project team
Latest reply from CodeHydro

Tags:

12 3 Next »

Giveaway of the Day project team

offline
Key Master

Hey everyone,

Thanks for being with us all this time and for suggesting many useful things for our project in other forum threads.
Right now we're working on a new evaluation system that would be more sophisticated and effective for developers, our subscribers and those who come here to get some info about certain software products.
We would be very glad to hear your ideas on how we can make GOTD better, what services you'd like to have here, how you'd like to evaluate software etc.

(Except for software suggestions - for that we still have another thread
that, yes, we check often and get much use of it.)

Any comments on improving GOTD are welcome.

Yours,
GOTD Team

Posted 3 months ago #
watcher13

offline
Member

We appreciate it, admin. From my point of view, the biggest thing you could do is what you now seem to be doing. That is, a greater involvement with the users. There were times in the past where you folks seemed like you were high on a mountain, far away. We suspected that you paid attention to this forum and the comments section, but there were times when there was so little evidence of it that we couldn't even insure newbies that you were paying attention. And there would be hitches on the main site without a blog post or any acknowledgement that anything was going on.

Now you see to be getting more proactive about using the blog, posting in comments when there's a problem, and, with this topic, showing us that you're trying to keep your finger on the pulse. And again, we appreciate it.

Anything to open the lines of communication. (Hope you don't regret that. We ain't short of opinions. :) )

Posted 3 months ago #
Lee

offline
Member

Well I read the forums for about 8 hours per day, sad I know, but I enjoy reading what others have to say and remove bad comments and links to spam.

I think what might be a good idea for rating software would be to be able to rate the software and/or games with a totaler.

I get the feeling it gives off a bad impression if users give a thumbs down even when they have not tried the application.

The last thing I downloaded and installed was Icon Commander v1.10, which is very good, not as good as Axialis, but, for a freebie great.

We also need to update the forum software as I think it's very old.

We need more functionality and the chance to add avatars, signatures and smilies.

There should be section to which only admin and moderators can post in to iron out disputes and problems.

We need to keep the core, which is a large section on software and games paraphernalia and then some small sub-sections on other things that are good as they help build a community and strengthen it.

Posted 3 months ago #
LeKanaw

offline
Member

Hello

I second Lee
=> We also need to update the forum software as I think it's very old.
Indeed!!

And improve the search functionality. It has become a running joke, and that's not good for the image of a forum that wants to be taken seriously.

The ratings in the front page are a "bit" of a problem, as ppl don't seem to understand they should rate the sw itself, not ««their»» need for the sw!!!

*********************
Hi Lee:
What is a "totaler"? Goggle has NO results(!) for Define: totaler

Peace

Posted 3 months ago #
Terri218

offline
Member

I really wish there was a way members could contact each other through a PM or something similar. Sometimes we'd like to follow through on a remark or something that might not be 100% on topic and of interest to other members. I know you are concerned about giving out codes, but there are many other things in the world. Maybe it could be filtered through the administrators if it doesn't get out of hand.

Posted 3 months ago #
Merri

offline
Member

To admin;
THANKS for having this sticky posted!
I am sure many will have great ideas!
I second Terri's idea about having a PM available for each member...
:)

Posted 3 months ago #
Whiterabbit-uk

offline
Games Guru

Some good suggestions already by you guys. also a way to post images. It would make my reviews much more readable, lol.

I totally agree with the thumbs up down system. It's too easy for someone to just click on thumbs down now (at least earlier when it was first introduced you had to give a reason why you were giving it a thumbs down). It needs to be updated or scrapped altogether and a better system introduced. There have been many suggestions already posted on this subject.

I think Lee means each person scores the software out of 10 and as each successive score is added you get a score for example 18 out of 20, 25 out of 30, then someone scores it low say a 1 out of 10 so the next total would be 26 out of 40 etc etc. I think that's a great idea. We all have different ideas as to how good a software is as opposed to a yes or no. At least with a 'totaller' it would give a more quantitative idea as to the worth of a software.

WR

Posted 3 months ago #
watcher13

offline
Member

I'd have to vote for the tied to download idea, like a survey. Now, and even restructured with totals and so on, the system can still be even rigged. If I really wanted to go to the trouble, I could rig the voting. Vote, clear the cookie, vote again. Only limited by my boredom threshold. An extreme example, I admit. But we're all saying the same thing. The current system can just as easily be a popularity contest than a software evaluation. It can even be a vote on whether you like repeats when a software is re-offered, rather than a sincere evaluation on the software. That's the bottom line: whatever you folks are considering doing, any level of greater sophistication will probably give you more useful results than you're getting now.

Posted 3 months ago #
Buckleysmom

offline
Member

All of the above.......

Hee hee......seriously.....either a totaller or a 1-10 rating system (like White Rabbit uses) would be great. Other than that the forums are......like.....stuck in the dark ages. In other forums you can do all kinds of things......change font size and color, use smileys, post graphics, pm other members, etc, etc. Sure would be nice to be able to do those things here. So, that's my 2 cents.
BK

Posted 3 months ago #
thenameipicked

offline
Member

We could do something like WOT (where there are multiple categories), without requiring it to be tied to the program. (Heres the rating of google: http://www.mywot.com/en/scorecard/www.google.com)
To achieve this there are 2 ways I could think of this...one is to have everybody vote up/down on each of the categories, and the other is to have a single up/down, and then say why. That way its informative to the developer on WHY its thumbs down. It may do it job faster than everybody else, but nobody may have a need for it.

Posted 3 months ago #
watcher13

offline
Member

I think you've got something there, name. Might even consider one of the categories as something like, "how much would you pay" although people wouldn't always be honest and would try and bid the price down, so to speak.

Posted 3 months ago #
thenameipicked

offline
Member

I don't see why though...unless they plan on purchasing it *after* the giveaway...which defeats the purpose of the giveaway :P

Posted 3 months ago #
Lee

offline
Member

@ Merri, totaller would be a bit like a stars system.

I don't want to copy a ratings system like 'I give it 4 stars or 4 cows out of 5'.

So it does not feel all so bad when an author sees 99 against and only 5 for his/her software.

The totaler could be used only for a select few to vote.

Posted 3 months ago #
watcher13

offline
Member

That's part of what I mean, name. Certainly, in the back of their mind - even subconsiously - their thinking, if I get hooked on it and lose it, I hope I don't have to pay an arm and a leg to get it back. Then too, I think, psychologically, people will always have that inner urge to see all software as cheap as possible, especially considering that most developers have the opposite impulse. That's one of the reasons so much software is overpriced. In other words, here in the states, we want to see gas at 50 cents a gallon and the oil companies want to see it at 5 dollars. If every video game was 5 bucks a pop it'd be gamers heaven. There's always that inner urge to get a bargain. After all, people come to GOTD in hopes of getting something for nothing. I think some people would even consider telling the developers that the free software was overpriced so the developers would consider dropping the price of other goodies in their catalogues. But perhaps I'm being too cynical. I guess developers would just have to take it with a grain of salt, like they do the voting now.

A "select few", Lee?

Posted 3 months ago #
Lee

offline
Member

Select few: members and those that have been using and posting in the forums for 6 months or more maybe.

Posted 3 months ago #
RosnSC

offline
Member

"All of the above......."

I agree with you, BK.

Sue - glad Watcher pointed us in this thread's direction...;)

Posted 3 months ago #
Giveaway of the Day project team

offline
Key Master

Graphics? Pictures?

............................................________
....................................,.-‘”...................~.,
.............................,.-”...................................“-.,
.........................,/...............................................”:,
.....................,?......................................................\,
.................../...........................................................,}
................./......................................................,:^..}
.............../...................................................,:”........./
..............?.....__.........................................:`.........../
............./__.(.....“~-,_..............................,:`........../
.........../(_....”~,_........ -,_....................,:`........_/
..........{.._$;_......”=,_.......“-,_.......,.-~-,},.~”;/....}
...........((.....*~_.......”=-._......“;,,./`..../”............../
...,,,___.\~,......“~.,.........................}............../
............(....=-,,...............................(......;_,,-”
............/.~,......-...............................\....../\
.............\`~.*-,.....................................|,./.....\,__
,,_..........}.>-._\...................................|..............`=~-,
.....=~-,_\_......\,.................................\
...................`=~-,,.\,...............................\
................................:,,...........................\..............__
.....................................=-,...................,%>--==
........................................_\..........._,-%.......`\
...................................,<.._|_,-&................\

well, I mean we might need a new forum engine:)

Posted 3 months ago #
wizzard_of_ozz2004

offline
Games Master

woohoo!!! hopefully that's a hint of what's to come!

Posted 3 months ago #
watcher13

offline
Member

Thanks, Sue, though one of the select few - I have no idea who and don't really care - didn't think it was that good an idea since that thread seems to have disappeared, despite the positive reaction it got. (Thanks!)

In any case, I see validity in Lee's point. However, we're mixing apples and oranges, since the voting we're debating is for the comments section, most of whose members aren't members over here. Do we REALLY want to limit voting THAT much? In fact, I'm not sure it would be good for the project's image if we limited it at all, except only to those who download. If we did eliminate the bulk of the posters over there from voting, the comments section would be jammed with their complaints daily, at least 'til we drove most of them off. Then we could have, say, a dozen daily posts where we talk to ourselves. I'm thinking that's not the way to go.

Posted 3 months ago #
RosnSC

offline
Member

You're welcome, watcher. I'm sure I know who, but the thread's closed, now, and really a moot point, now. The main thing is that we now see this thread, and are discussing its topic, which is a darned good one.

As for who gets to vote, and who doesn't, I think the voters should be either those who download/try out the day's offering, or have tried it previously, elsewhere. Perhaps instead of the 'thumbs up/down' system, we should do an individual 5-stars rating system, having the moderators throw out any who mark stars but don't leave a comment to support their vote. With that in mind, I disagree with Lee's idea of a "select few". I feel anyone, at all, who tries/tried the software and leaves a (valid) comment/star rating should be heard, whether or not they are a forum member.

Sue

Posted 3 months ago #
thenameipicked

offline
Member

Maybe we could have the normal rating system, but have the question above it "How useful is this to you?", and when somebody makes a post, they can vote on other categories such as "Speed/Efficiency", "Layout/User Interface", "Features", and "Overall"??? (Possible X/5 system on these categories" Anyway, these stats will still be posted at the top, you just can't immediately vote on them.

Secondly, could we have a "Report" link on the giveaway comments like on the forums?

Posted 3 months ago #
title1admin

offline
Member

I have an idea I'd like to pass on... an active repository of developer software; in which each user would require registered access. The developer agrees to actively post accessibility to the software for an extended period of time up to one year. Feature software once a day as usual but two days out of the week allow the user choose the download of the day or have up to five featured software for the day an allow users to choose ONE download per day.

Rate the popular software and post for users to see. (user's choice) rank by popularity and push results back to developer with eval tip off sheets. Have the developer review and offer them an extended featured item slot after they've improved the product.

However, only those whom have actively visited the giveaway for the day would be eligible to download it for a year. Users required to update account info every quarter. (Giving you a more accurate account of the audience)This extends to the user the same courtesy's of a giveaway with the convenience to evaluate the software with more realistic feedback results.

How to make it work on an individual basis??? auto seed the encryption...unique to each individual's private key (generated upon sign up......) however, still offer featured software the same way as now but after X amount of downloads require the user to register for an improved experience.

Secondly, require each user to fulfill an evaluation survey prior to the next available download. (requires user to send a small yet quick evaluation on previous download) After all, you are providing free service to the audience. It should be mutual but simple yet untaxing on the end user as they tend to be lazy and frustrate easily. Weeding through eight hours of post is a tough job; if the surveys were quick and concise to a ten point/question structure this could be posted on the site and stored in the cookie, But giving the developer better feed back as to the whys.

My hat is off to the GAOTD Team. Many, many thanks for your for your brilliant and exceptional efforts!

Posted 3 months ago #
RosnSC

offline
Member

If I've understood you, correctly, sounds like a good idea, title1admin.

Sue

Posted 3 months ago #
watcher13

offline
Member

The base idea, more time to download, would certainly get GOTD more downloads. The problem, as I understand it, is that GOTD makes money on every visit to the site. So you need to come up with some way to do what you say, but not significantly hurt the site's daily traffic. If people are only going to come once a week, month, or quarter; it's probably going to hurt the business model. Again, if I understand it correctly.

Posted 3 months ago #
Quantum Dragon

offline
Member

Some thoughts:

1) On the daily giveaway page: A new rating system that shows the appreciation by visitors of the software in actual use "NOT" if you like/dislike the company or concept (I.E. thumb it up if it is easy/helpful/fun ...and so on... to use "AND" thumb it down if it is buggy/calls home for no reason/crashes your system ...ETC...)

Yes, a ten point quick survey would be good too!

2) On the forum pages: A new forum system is in order as some other sites have embraced the (so-called) WEB 2.0 philosophy which is more pleasing to the eyes.

After all, we live in more Social Web oriented times!

But it should be accompagnied by a solid control system to avoid going overboard (a bit like the actual system but on a more timely fashion).

3) Here is another idea while we are on the forum subject: Define two forum orientations (or MAIN sections).

A) One (more technical) for proposing programs for future giveaway, making us aware of interesting sites, freeware or open-source programs like it is done now.

"AND"

B) One (more social) for discussions (Palaver, Pow Wows, Friendly chats) between members.

That would facilitate navigating in the software and site suggestions without the frustration of having to go through the many private conversations that spring up between a few "select" members.

In short, a main section for suggesting that would branch out in sub sections "AND" another main section for discussing anything which would also branch out in sub sections.

4) Either A) Revamp the "Freeware/Open-source" section so it goes past index2.html in latest releases, to make it more actual everywhere else and to weed through and eliminate "obvious" Adware items.

"OR"

B) Replace it with "links" to the many freeware sites which are active and checked for "fakes" every day.

Hope this helps

Quantum Dragon AKA Paul

Posted 3 months ago #
title1admin

offline
Member

watcher 13: The concept is.... continue to do what GAOTD is doing but expand the idea by offering up to five different selections per day of which a user could download; The business model would increase the traffic due to higher availability; word would get around REALLY quick.

The changes on the back end which support the same business model but include some small modifications of agreement/requirements on the developer side to extend availability of the product for an agreed amount if time. (Flexibility for developer)

To support an increased active user base, require a small demand from the user: update the login account on a regular basis to establish an active account. Require the user to evaluate the previous software in some shape or fashion. I suggested a quick 10 point review or more accurate reasoning / rating of the product.

This is what I interpret as the current business model:

* Professionally publishes a variety of ratings and/or reviews quickly and easily
* Full-featured software with "NOW" availability
* Low Total Cost of Ownership:Low startup costs with continuing low operating costs
* Increases site traffic, audience participation and value to users

Expanded Suggestions to Include:
* Supports ratings, reviews, and combination for software listings
* Supports multiple ratings criteria per listing
* Display rating results in real-time(Displayed both as text and graphic)
* Allow developer self submission (after GAOTD review and signed online agreement)
* Authorized developers/self-publishers for to post replies/comments for any of
their reviews (Moderate the review as an option. Advertise to online user base)
* Allow Developers/registered users to perform a "youtube" review of software
* Allow developers to demonstrate or introduction training to product
* Realtime review of software evaluations to developer (Dev priv option)
* Allow review of all ratings of all products via developer "overall snapshot"
* Integrate with 2.0 technologies to include SMS posting & review from phone
twitter, facebook and myspace integration with cloud tags and the like. The key
point here to create more avenues for individual users to conveniently respond.
* Offer exclusive discounts to GAOTD fans via registered account. (incentive to
register) or maybe an extra download every so many days...
* Catalog and organize software - previously reviews and ratings
* Use bayesian formula to calculate average rating
* Display options for the following: new top 20, popular top 20 and top 20
discussed

Revenue Opportunity
* Sell Sponsorships that prominently feature the developer in one of the five
slots displayed on all the GAOTD website page headers
* Charge for self-publishing accounts that allow developers to provides replies
/comments to a review
* Offer a subscription service to end users - set up a fee schedule
* Restrict viewing of ratings and reviews to registered subscribers
* Sell targeted developer advertising (based on application interest on GAOTD by
page location.
* Developer offered incentives from vistors reviewing an organized GAOTD software
catalog. Referral fee to GAOTD

Posted 3 months ago #
title1admin

offline
Member

Possible 5 Star Rating???
Excellent
Very Good
Good - met expectations
Fair - Basic program. Could use improvement.
NR - Not Rated

Basic Criteria Needs:

* Features and Performance (compared to competitive products, maybe?)
* User Interface design and usability
* Ease of Use and Documentation
* Uniqueness and Innovation
* Efficiency
* Pricing
* Personal opinion

Software Evaluation Criteria

Content:

* Does the program effectively leverage a new opportunity / new skill?
* Original and innovative? If not, is it a well done classic?
* Is the learning curve appropriate - neither too easy or too hard?
* Opportunity to explore and experiment as a means of learning application?

Entertainment Value:

* Does the software possess significant "appeal" ?
* Software fun enough to try again? Addictive?
* Engagement in scenes and/or characters?

Design:

* Challenge Difficuly has relatively broad range? If so, is it easily adjusted?
* Well designed intutive interface?
* Appropriate help files/ manuals/ onscreen help?
* Program thoughtfully produced and explained in summary?
* Does it increase user productivity?

Replay Value/Shelf Life:

* Will users want to reuse software in the long run?
* Does the software contain enough content/use to have a decent shelf life ?
* Can users at different skill levels enjoy this program?

Value:

* Is this title worthwhile for the suggested retail price
* Would this program make a valuable addition to a user's software collection

Posted 3 months ago #
copmom

offline
Member

Personally I've come to rely on the thumbs up/down at the top of the offerings, and really don't pay attention to the (+) (-) after the comments are made.

I do pay close attention to comments made by certain regular posters and I've grown to depend on their opinions, as they normally steer us in the right direction before we waste hard drive space on a download.

So, yes, there does appear to be a need for ratings, but I do agree it should be limited only to those that actually download what is offered to get an actual 'users' opinion.

I have noticed the moderators have made a drastic difference in getting rid of all the 'junk' comments that have no relevance to what is actually being offered that day, so kudos for that!!

Posted 3 months ago #
watcher13

offline
Member

title1admin.
A lot of what you're saying is brilliant, but I think you're designing for a different company. I'd love to see GOTD offer more software at one time, but there's two difficulty with what you suggest. One is, even if you offer any software for only 2 days and have a different one every day, I still only have to come to the site once every 2 days and not missing anything. That cuts my vists in half. The longer you offer each giveaway, the less I have to come here to stay caught up. Which at least decreases that part of GOTD's profits, and they may not be convinced that your plan will make that up. Secondly, look how detailed that business plan of yours is. It would be great to submit in a college class. But what makes you think that GOTD has the time, the personnel, and the expertise to implement a lot of that. "Integrate with 2.0 technologies to include SMS posting & review from phone twitter, facebook and myspace integration with cloud tags and the like. The key point here to create more avenues for individual users to conveniently respond." May sound simple to you, but we don't know how many of the GOTD people have the expertise to learn or do that, if any. We don't know how many people are even involved in the project. I've never seen anyone share that with us. It could be just 2 or 3, and they may spend all their time scaring up the tomorrow's software.

You've designed a business plan for a small to medium size company, and this is probably just a cottage industry. This, after all, is a project that is sporadic about keeping people informed, often doesn't even have enough moderators for it's comments section (and most of those are overworked volunteers with no official connection to the project), has had occassional prolonged server outages, and occassionally has to rerun giveaways because of a major problem with the giveaway's package. And, after all, they only really asked us how to tweak the eval system. I'm not sure they're ready or interested in a ground floor rebuild.

I'm not trying to be insulting, your assesment has a lot of brilliant ideas. But you gotta walk before you can run. If you really think I'm being unfair to you, my best suggestion would be to take the model and try to compete with GOTD. You may really have something there, but don't think it will be easy.

I think you make 3 suggestions worth immediate consideration. Some kind of software pool. Maybe a developer offers all their wares on a single day. But then, you've got to find enough developer's for that. Requiring accounts to comment on software also has merit. You'd lose some people who just don't like to join, but I'm not sure the end result wouldn't be better, although just restricting to downloaders might be all that's necessary. And you've got a lot of good eval ideas. The question for everyone, though, is: do people want to just give a quick evaluation or do a detailed survey? I don't know the answer to that one.

Posted 3 months ago #
title1admin

offline
Member

Hey Watcher13 Thanks for the input. No offense taken here. I was merely throwing out ideas as asked by Admin..... that's what it's about... if GAOTD can gain ANY momentum from any suggestions brought to light, I'd say great!

You possibly may be correct on the traffic, but considering a restriction to only one download per day still generates the traffic and to see what's available will entice a continued revisit. I like the one a day concept though.. it's bullet proof. Maybe a pre-screener of what's coming up for giveaway (with no specific date) could entice more traffic.

I am definitely unfamiliar with GAOTD's business model; sometimes technical and analytical knowledge get in the way of the KISS principle. I barely have time to blog/post much less start a compete! I would not post a business model if a complete was in mind. <grin>

If nothing is changed, I still love this site and I greatly like the concept and appreciate the GAOTD Team.

Posted 3 months ago #

RSS feed for this topic

12 3 Next »

Reply »

You must log in to post.