Posted by joomlerrostov on February 22, 2010 at 2:45pm
Feature request
may i ubmit a feature request - i think it will be helpful if Quiz will have advanced reports with various statistical variables.
As i see here http://www.questionpro.com/results/ there are great options to automatically render:
1) frequency analysis, including percentage and answer cout per every question's variant
2) key statistical analytics, including Mean, confidence interval, standard deviation, standard error, AVERAGE balanced assessment
i guess that some of these is posible via Views, but dont see how to implement Delphi method for example
please point me if you know how to do this
Comments
Quiz isn't for surveys
The features you describe suggest that you're doing survey analysis.
The Quiz module is for assessing knowledge. Mean and SD of answer responses don't really matter.
You'll have more luck with the Webform module.
http://educoder.org/
http://openeducationresearch.org/
I disagree.
I think Mean and SD are very important for a quiz intended as an assessment. I've been working with faculty for 10 years, and I can assure you, they are used to having this feature, which they use for scaling, motivating students, and just to easily know how hard or easy their quiz was. They also like to know which questions were easy and which ones were hard, and which incorrect answers were most popular. Information like that helps professors refine both their assessments and their instruction.
I'm not saying this is a huge priority, but at some point, it really would be nice. It's very hard to promote quizzing in Drupal when widely available features like this are absent.
+1 Becky Kinney even going
+1 Becky Kinney
even going beyond "hard to promote" I have encountered the need to fold features of this kind in a less desirable fashion.
Item statistics
Yes, instructors want to know how students are performing on question items. My understanding of the request is for the mean and SD of the answer responses on scale items. E.g. three people chose 3 and two choose 4 for a mean of 3.6. I don't see that fitting into Quiz.
It would be nice for Quiz to report on the performance of items with regard to getting answering correctly. Mean and SD would fit well there, along with the distribution of incorrect answers.
http://educoder.org/
http://openeducationresearch.org/
in that case
If your interpretation is correct, I totally agree. That type of data is more appropriate to a survey.
Quiz isn't for surveys
I am sure that your criticism is well meaning, but I don't think that you appreciate why these statistics are not only important but are critical for the proper validation of tests. You are seeing a quiz as a rather informal test, but there are formal diagnostic, achievement, and aptitude tests, where there are a wide sample of measures that a professional test developer will use to determine if the test itself is meets professional standards.
Here is one example. Let's assume that you had a 100 question Algebra test. How well does it measure knowledge of Algebra? One standard technique is called "Split Half Reliability". This is a technique whereby the 100 question test is randomly split into two 50 question tests. Then each of the tests is scored separately for each person who took the original 100 question test. The two scores for each individual are then correlated statistically. Consider the implication if the correlation is very low. It would certainly indicate that something is wrong with the test. So for professional test makers having high split half reliability is a NECESSARY though not sufficient contititon for claiming a test is valid. There are many other such tests.
The suggestion for the statistics for all of the items separately is but the first step if Drupal is to be a SERIOUS professional test platform. We will need a Module for Split Half Reliability and a number of others. The first and most basic is the request for the statistics module which you incorredtly percieved was necessary only for surveys.
Statistics on quizzes
If you're addressing my initial comment, I think you've not read my follow up comment "Item statistics".
Statistics certainly do matter for assessments. I've actually considered writing an IRT modeling sub-module for Quiz.
The feature request wasn't for "statistics" without qualification. It was for statistics like in http://www.questionpro.com/results/ , which reports on the distribution of responses per se, not whether they are correct or anything like that. Those type of stats I think are more appropriate to Webform, but I may be in the minority with this view. Vegardjo explains how you can already use Quiz for surveys.
http://educoder.org/
http://openeducationresearch.org/
delete
My last comment got posted twice. Unfortunately there's only an Edit function and no Delete.
http://educoder.org/
http://openeducationresearch.org/
Not entirely true
Hia,
First, @joomlerrostov please add your feature requests in the issue que for quiz, that is where all this is gathered, assigned etc! http://drupal.org/project/issues/quiz :)
Second, this is actually a feature that will be partially implemented in quiz. Look at one of several feature requests here: http://drupal.org/node/501858 - the feature is however postponed to Quiz 4.1
I believe we will get percentage and answer count per question, and probably also mean value, but not the more advanced one in 2 above.
Also, we have the scale question type in quiz, so it will be used for small surveys too :)
Thanks for replies, but there
Thanks for replies, but there are impossible to use Webform module, because it doesnot provide integration with Views, i cannot render Webform fields values throught Views...
Is there any way to get via Views a value of the question, for example when i create multichoise question with several alternatives:
Who is president of Russia? and alternatives : Medvedev, Obama, Putin. when user took quiz i want to build a table via Views with data, particular user that have chosen a particular alternative.
like this:
User1 Medvedev
User2 Putin
................
and, if alternatives will be i numerical type of data, it is possible to get some statistical data via Views calc module http://drupal.org/project/views_calc
Hahaconda - Premium Drupal Themes Club & Marketplace