Quiz 4.x planning
After a lively thread on separating a question bank from the quiz module, it was suggested to start a new one planning Quiz 4.x.
What would you like to see in Quiz 4.x? Here are some ideas so far:
Quiz/Question Bank module
- Allow question items to be edited and viewed without the assumption of quiz-taking. (Currently "View" of an item sets up a quiz-taking interaction.)
- A quiz is a list (ordered) of question items.
- A collection is a set (unordered) of question items and/or quizzes.
- Feature to render the quiz into paper (print with stylesheet or export PDF)
Interaction Assessment module
- An interactive assessment node points to a quiz and configures how it will be used by a student.
- Options might include:
** One question per page
** All questions at once
** One question per page, adaptive style (harder after question is answered correctly, easier if question answered incorrectly)
** move personality quizzes into their own separate module, "since the logic for those is so different that it requires hacks all over Quiz to accommodate." (mbutcher)
Data interchange
This doesn't require any refactoring and can evolve in the 3.x series. mbutcher wrote a QTI 1.2 importer and sivaji implemented it as a Quiz Import feature in the module. I adapted that to a Quiz Export feature which uses Moodle's code to export into a number of formats. ATutor has better support for QTI and I may also re-use its code. Anyway, some ideas:
Export
- export to GIFT (done)
- export to Moodle XML
- export to QTI 1.2 (full quizzes)
- export to QTI 2.0 (just question items)
- export to QTI 2.1 (full quizzes)
Import
This one's harder since the incoming data may have features that the Quiz module doesn't support.
- import from Aiken (done)
- import from QTI 1.2 (done, but not rigorously tested I think)
Sivaji's GSoC
And then there's everything Sivaji is doing for the Google Summer of Code. Will all this make it into 4.x?
June 14 - June 25 :
Quiz Results Import/Export
June 27 - July 10 :
Quiz Admin Dashboard
July 12 - July 25 :
Quiz Students Dashboard
July 27 - August 5
Ajaxifying quiz
August 6 - August 20
Simpletest
Documentation
Well, I hope that gets the discussion started. Some of these item will probably spawn new threads or issues, but it will probably help to have this common thread for hashing out the 4.x vision.
Scoring
Different methods of scoring and assigning points are also highly desirable. The original Quiz module only allowed 1 point per question with no weighting. We've worked a little on expanding this, but what we really need is a well-thought-out, use-case-based plan.
Matt
Blog: http://technosophos.com
QueryPath: http://querypath.org
Created issue
hia mbutcher, I tried to answer this by creating an issue - hope that's fine :)
block view
I just joined this group, and I've never even seen the Quiz module, so I hope this post won't be completely incoherent. I like to put quizzes into a side panel so that students can answer questions in context. This is more useful for a self-test than for something they'd be graded on, but I would love to be able to see a block option for quizzing in general. I would also like to see a quiz engine that allows me to put in Flash-based questions. I build a lot of simulations and I often need a way to incorporate quizzing. I much prefer questions that pop up in context than something that has to be visited on a separate event.
My university recently adopted both Sakai and Drupal almost simultaneously. We are falling all over ourselves trying to figure out how to make best use of each. Obviously, Sakai is a more natural fit for anything involving a grade, BUT the Sakai test engine is truly pitiful, as is the Sakai gradebook. Drupal is so much easier to work in, I wish we could abandon Sakai altogether. Fat chance.
+1
I second this request - it's very useful for our students to be able to go from page to page and answer a question (and get feedback) at the bottom of each one (for example).
(I also would love to have a 10 questions-per-page kind of quiz, as well :)
Here're a few features I'd
Here're a few features I'd like to see to make Drupal more of a competition for established VLEs:
Dominik
Dominik Lukes
http://www.bohemica.com
http://tuit.glottalstart.com
import from Hotpotatoes
@bohemicus, import from Hotpotatoes is in progress now using Moodle's importer code. You may want to view subscribing to the issue ticket: http://drupal.org/node/473628
Do you have any sample items we can use for testing?
http://educoder.org/
http://openeducationresearch.org/
Various feedback
Hia, I'm new to this group now, but have assessed how we could use Drupal for some LMS tasks in the past and am very glad to see the quiz module developing so fast again! The roadmap looks great so far :)
I'll add some various feedback here in no specific order, in the hope that it can be useful for you. I'm very familiar with ATutors quiz module, and have been teaching our users (instructors) to use that for quite some time now.
separate question database (and questions categories)
The idea to separate the questions from the actual quiz is very good and makes a lot of sense. We've used this for years and it's very flexible. But one thing I miss in that respect is the possibility to categorize questions. Question databases tend to grow very large over time and a way to separate the questions within it is vital.
You could do this with adding taxonomies to your site and then setting all the content types for questions to use this, but having an own question / quiz taxonomy for the quiz module would be better I think.
Adding questions
The possibility to add new questions through the manage quiz screen, not having to go through create content -> question is also very good, I cannot remember that being so in previous versions? I have some more suggestions though :)
First, and you probably know this, the title is left blank if you don't type anything in it, exept for the MCQ type:
Having to add a title when you create a question is a lot of work, and in many cases doesn't add much value. So, just using the first words of a question as the title if you do not type one is a good idea. However, it seems to be trimmed after about 10 characters now? I would personally allow for some more!
Also, I would consider tweaking the add question screen a bit:
just focusing more on the question than the title. However, I realize I can do this myself with managing fields for the content type.
various on question types
Admin feature requests
I don't know if this is a part of the roadmap, but getting statistics on tests is a much used feature here. That is, getting "statistics" in addition to "Quiz results" (per user) under quiz management -> quiz reports would be nice. Then you could use Drupal for surveys!
That is all for now - the good thing is that we are probably able to help with some developer resources on this module now, but we haven't really figured out where it would be best to jump in? Is this something you are accepting at this point, and what would you think could be a good idea to start to help with?
(BTW: I can help with testing the QTI import stuff when that arrives)
issue tickets
vegardjo, these are excellent suggestions. Would you be willing to submit some of them as "feature requests" on the issue queue? That will help them get implemented. I think the issues with question titles is one of the most pressing and potentially controversial.
You wrote that you use ATutor currently. Have you also used Moodle? I'm evaluating them each as a replacement for our question data model. ATutor seems to much better support IMS standards (such as QTI and CP) but Moodle has many more users.
http://educoder.org/
http://openeducationresearch.org/
Done!
Hia turadg, thanks for your feedback! I've added a few of these as issues as you suggested:
We do use ATutor, and I have always preferred it over Moodle because of what I feel is better usability. However, I haven't used Moodle a lot so it might be unfair of me to say so. Atutor has always been strong on standards, but I do believe the QTI export / import is considered relatively experimental still. I'll give you a question dump in QTI 1.2.1 and / or QTI 2.1 from ATutor if you need one!
@vegardjo man you are
@vegardjo
man you are awesome, thanks for taking such a great effort to improve quiz module.
Certificate module
Thanks sivaji, allthough I am not the one to thank here - your roadmap for Quiz is great and very promising! :)
We'd like to sort out how to create a certificate module in Drupal too, so please add your comments here! http://drupal.org/node/501874
Integration with Rubric module or ability to have rubrics?
I'm working on the Assignment Studio (since you contacted me I'll guess you knew that...anyway) I'm releasing the AS soon and starting on a plugin for it called "Rubricator" which allows you to create rubrics via Drupal, save each one as a node, and then the assignmentstudio will let you associate an assignment (other node submitted) to a rubric (instructor submitted node). There will be a rubric used per assignment (taxonomy term) which ties it all together.
I had been asked in the past if the Rubric module could be used as a stand alone once created but would that be something people would be interested in doing as part of Quiz module? Quiz is a bit limiting of a word, I'd think of it more as "Assessment". Rubrics being one way you assess people (quizzing too). Could anyone else see use for Rubrics in the Quiz module? This could be used for assessment of free-response quiz answers that are text input and subjective in nature (which is where the project originated, we have instructors gauging artwork).
Either way works for me but figured I'd throw it out there since I'm writing it right now and could easilly try to make it more API-like to be used w/ the quiz module as well as assignment studio.
"Plaguing the world with Drupal; One Plone, Moodle, Wordpress, Joomla user at a time since 2005." ~ btopro
http://elearning.psu.edu/
http://elearning.psu.edu/projects/
http://elearning.psu.edu/drupalineducation/
Assessment module
btopro, I think the Rubrics and Quizzes fit well together, as you say, under the umbrella of Assessment.
There are several contributors to Quiz who'd like to see it expand beyond automated quiz-taking. The ClosedQuestion module doesn't have any scoring at all, just feedback.
Maybe we can begin a new module, Assessment, that uses the Quiz, Rubricator, ClosedQuestions and other modules to create a unified management system for assessment materials.
What do you think?
Putting it all together
Looking at the different "systems": quiz, adaptive quiz, case/Lesson, they obviously have in common that they use questions.
The differences are in the ordering, navigation, allowed number of tries and whether there is scoring and timing.
It could be split into several separate modules, a core for common things, one or more modules for question types, and a module for each "system".
On the naming front, if there is no scoring, timing or tries limit then it's not really an Assessment... But I can't think of a better name either :)
Some additional thoughts
I thought I made a long posting here, after Turadg's comment on my "Using Quiz for things that are not a Quiz" thread, but I seem to have forgotten to actually post it... :(
The way I see it, a quiz is just one way to order questions. Questions can also be used "inline" in a book, as practice opportunity, stringed together in a case, or in an adaptive system. So it would make sense to separate the question from the quiz, maybe even in separate modules. That way different modules can present the same question types in different ways and questions can even be presented on their own, without quiz, as Becky Kinney mentioned.
When questions are used for learning instead of testing, the feedback is very important. Especially incremental feedback that changes with the number of (incorrect) tries a user needs. Just having one feedback item per option isn't sufficient in that case.
Specifically on the point of adaptive systems, we currently use an adaptive question-system described in this paper: http://www.editlib.org/d/21709/article_21709.pdf and one of my jobs will be porting it to Drupal.
As part of learning Drupal I've ported the question part of our system to a Drupal module. I've not yet Quizified the question type yet. It currently supports MultipleChoice, MultipleAnswer, Choose Terms, Give Value, Select&Order, (Mass)Balance, Hotspot(graphical) and Drag&Drop(graphical). It doesn't have a question editor, it takes the question as XML. Comments would be appreciated :)
http://hylke.pk.wau.nl/drupal/sites/default/files/closedquestion.tgz
access denied
I wasn't able to access the pdf. Could you provide brief summary? I am definitely interested in questions that target learning over testing, and adaptive systems sound great also. Are you part of a research group?
Research group
I'm part of a (small) group at Wageningen University working on developing innovative learning materials, mainly for university level education. (http://www.ldi.wur.nl/UK/WMMRC/)
If you send me your email address through the contact page I'll email you the pdf.
Similar to Moodle's Lesson activity?
What you say reminds me of Moodle's Lesson activity which is a highly adaptive feature:
(from http://docs.moodle.org/en/Lesson_module)
So, yes, I agree that it should be possible to use questions from the question bank outside of quizzes.
Cheers,
Frank
Teacher input
That describes what we call a "case". A very traditional adaptive system, where the teacher has the think of all the possible paths through the system. Those are very useful for To properly implement a course in a system like that takes a LOT of effort for the teacher. In the system described in the paper the system determines what the next question will be. The teacher only needs to specify what learning objectives a question deals with, and per learning objective two numbers: The minimal level the student needs before he can answer the question, and the level the student has if he can answer the question correctly in one try.
If you're interested in the paper, send me your email address through the contact page, then I can email it to you.
The case type of system is also something I'd like to see implemented in Drupal by the way :)