Posted by agentrickard on September 18, 2008 at 9:58pm
3.5
12% (2 votes)
4.0
35% (6 votes)
4.25
18% (3 votes)
4.5
18% (3 votes)
4.75
18% (3 votes)
Total votes: 17
What minimum average rating should a proposal have to be considered for review?
Comments
Review & Revise
Proposals with rankings of 3.5 or higher should be considered in the monthly review process. The review process is a good way to help the applicant revise the proposal into something that may be suitable.
http://www.johndbritton.com
--
http://www.johndbritton.com
Review within the community, or review by Knight?
When I first read this, I assumed you were referring to review by the Knight Foundation -- but, on seeing johndbritton's comment, I realize that it could mean the monthly IRC reviews --
Any app, regardless of rating, should be considered/discussed during the IRC review --
However, to be passed over to the Knight Foundation, the rating should be 4.5 or better -- I also think that the quality of the comments/discussion thread should be considered. Only looking at ratings/number of votes can be misleading. The comment thread around a proposal provides a much richer view of the application, and how they interact with the community, and, IMO, that's an important facet to consider.
FunnyMonkey
Tools for Teachers
FunnyMonkey
Drawback
Here's an example:
Application A is a good idea, but may not be 100% ready and it gets an initial rating of 4.0. After review and revision the application is much better, but it may be difficult to get the voting score up to 4.5 or higher.
IMHO the star rating should not be a fixed factor in whether or not a proposal gets passed on to Knight. It should serve as an indicator of community support, but the comments and discussion are much more important than the number itself.
http://www.johndbritton.com
--
http://www.johndbritton.com
Clairifcation
I originally meant "pass to Knight" -- the process we have been using says if a proposal has 10 votes and a rating higher than 4.0, we approve it and pass it off to Knight.
We consider all apps during the monthly review meetings, even those below the cutoff, with the idea of helping those proposals improve.
I think that johndbirtton may be right, and the ratings may just be a guide. But it's hard to be fair without a qualitative standard.
--
http://ken.therickards.com/
--
http://ken.therickards.com/
Fairness
While fairness is a consideration, proposals should be passed on to Knight based on merit. If a proposal has a decent rating and sufficient comments, it should be passed on... if not it should be revised and passed on at a later date unless the proposal is abandoned or deemed unworthy by the community. There have been quite a few new proposals in the past few weeks; it will be quite difficult to decide which ones get pushed to Knight. I believe that the process should be focused on the quality of comments/reviews rather than a specific rating to get promoted.
http://www.johndbritton.com
--
http://www.johndbritton.com