Assessment Item Writing: Clear Questions, Distractors, and Review Checks

Kickoff to Excellence

Assessment item writing involves creating clear, purposeful, and fair tasks that measure the intended knowledge or skill without irrelevant difficulty. Give learners the information needed to answer without requiring them to decode ambiguous wording. The PNCB Item Writing Manual provides additional item-writing guidance.

Ensuring Clarity and Precision

Write each item stem in direct, necessary language, include the information needed to answer it, and focus it on one problem or learning objective. The item-writing review discusses how clear stems can reduce processing unrelated to the skill being assessed; verify fit through review and item data rather than assuming comprehension will rise.

Some teacher-approved clarity tips:

• Use direct, concise language—ditch complex jargon unless it’s part of what’s being assessed.
• Organize information logically (chronologically, spatially, or hierarchically).
• Rephrase negative stems into positive ones where possible to prevent confusion.

Aligning Items with Learning Objectives

Align each item with the intended knowledge, reasoning, or performance and the decision the evidence must support. Identify the cognitive action required by the objective and remove reading, language, format, or background demands that are irrelevant to that target unless they are intentionally assessed.

Aligning well means:

• Explicitly connecting each item to a stated objective.
• Ensuring the format fits the skill—use performance tasks for application, constructed response for synthesis, etc.
• Checking for content validity to make sure the question truly represents the skill or knowledge area.

Balancing Difficulty and Cognitive Demand

Do not confuse item difficulty with cognitive complexity. Difficulty is an observed response pattern in a particular administration; complexity concerns the reasoning the item requires. Build a deliberate range only when it serves the assessment blueprint, then inspect item performance, access, clarity, and alignment rather than assigning items to confidence or brain-stretching roles.

Pro tips:

• Adjust difficulty by tweaking complexity, not by making distractors “sneakier.”
• Use item analysis data to refine the balance for future tests.
• Ensure plausible distractors that require actual knowledge to dismiss—see the guidelines on high-quality answer choices for inspiration.

Ensuring Validity, Reliability, and Fairness

Item review should examine validity, reliability, fairness, accessibility, language demand, and whether irrelevant cultural knowledge affects performance. A classroom checklist does not replace a formal technical review for high-stakes use.

Consider these checkpoints:

• Run a fairness review for each item.
• Follow accessibility guidelines to accommodate diverse learners.
• Use consistent style, tense, and grammar to avoid cues or distractions.

Review, Revision, and Continuous Improvement

Treat test development as a cycle. After an assessment is administered, use distractor analysis, item discrimination, and other psychometric techniques to identify questions that may need revision before future use.

1. Review: Check each item against objectives, clarity standards, and fairness criteria.
2. Revise: Adjust wording, reorder stems, or replace weak distractors.
3. Retest: See if changes lead to improved internal consistency and reliability.

And don’t forget to keep a running “assessment playbook” so your team’s best practices are documented and shared.

Reviewing Results and Revising Items

Use student responses and item-level patterns to check whether each prompt is aligned, interpretable, accessible, and at the intended cognitive demand. Revise an item when the evidence suggests ambiguity or construct-irrelevant difficulty rather than assuming the item inspired thinking.