Asking the right questions - Creating Tests, Assessments, Surveys

Asking the right questions is extremely important when creating an assessment, test or survey.
There are many different types of questions that you can ask, depending on your desired outcome. A link to a training video on this information is http://www.youtube.com/watch?v=mmRThsz2wHI

Overall, the key to design is to stay focused. Trying to accomplish multiple goals will make for a confusing document that may not serve any useful purpose. In the design process, one of the first three steps that you will take will be to create the assessment. 1. Analyze Tasks, 2. Identify Objectives, 3. Design Assessment. The assessment is not a wrap up thought after all of the content has been created. When you prepare the assessment in that fashion you are summarizing what was taught versus creating the content specifically to meet the objectives of what is to be learned.

What do you hope to accomplish? Are you measuring their progress, helping them measure their own progress, certifying knowledge or skills, motivating, teaching new knowledge or skills, or understanding where they are with skills and knowledge. Know what you are trying to measure so you stay focused on that objective.

When you create assessments, tests or surveys it is vital to understand What you want to know or achieve. Then you have to design each question to create the answer in a specific format. First ask if the questions will be graded by a computer or by a human. Depending on the type of evaluation, tells you how you can define the answers.

If you want them to:

• Make a judgement - use True / False or Yes /No . This also allows for multiple paths to be built
• Categorize - Pick One
• Characteristics - Pick Multiple
• Recall facts, numbers, specific information - Fill in blank
• Associate - Match
• Chronological order - Sequence
• Create - Compose original work
• Perform - Simulation

Common mistakes: Avoid giving away the answer, layering questions, using all of the above or none of the above. Provide realistic choices , consistent formatting for grammar, and simplify the correct answer. Randomize the answers, make answers the same length, sequence the questions effectively. Vary the form of the question to achieve the desired answer or confirm specific learning objective. Give feedback that is straightforward, not embarrassing or patronizing and provide the answer in the reply.

When creating any assessment, return to your original objectives for every question. If it does not meet the learning objectives, you don't need it.

What challenges have you faced when creating a survey?

Brooke


References:
Horton, William. (2006) E-learning by Design