Item Analysis Calculator (Difficulty & Discrimination Index)
Analyse a test item from the number of high-scoring and low-scoring students who answered it correctly: the difficulty index (p-value), the discrimination index (D = upper − lower), the point-biserial approximation, the ideal difficulty for the number of options, and whether to keep, revise or drop the item.
How it works
p = correct ÷ total; D = p_upper − p_lower (upper and lower 27% groups); ideal p ≈ (1 + 1/options) ÷ 2; max D = 2p (p ≤ 0.5) or 2(1 − p); point-biserial ≈ correlation of item score with total
Classical item analysis judges each question by two numbers. Difficulty is simply the proportion who got it right — misnamed, since higher means easier — and the most informative items sit midway between the guessing rate and perfection, around 0.6 for four-option questions. Discrimination asks whether the item separates strong from weak students: the difference between the pass rates of the top and bottom 27% (Kelley showed 27% is the best trade-off between group size and separation), or equivalently the correlation between the item and the total score. Items with D above 0.3 are doing their job; near zero they add noise; negative values almost always mean a mis-keyed or ambiguous question, and a quick look at which distractors the top students chose usually reveals why.
Worked example
39 of 60 students answered correctly (p = 0.65, moderate, close to the 0.63 ideal for four options); 14 of the top 16 and 6 of the bottom 16 did — D = 0.875 − 0.375 = 0.50, very good, reaching 71% of the maximum 0.70 possible at that difficulty. Keep the item.
Frequently asked questions
Should every item be hard?
No — a test of moderate items (p ≈ 0.5–0.7) maximises score variance and reliability; a few easy items at the start reduce anxiety and a few hard ones separate the top. Mastery tests deliberately use easy items.
How many students are needed for stable statistics?
D from 27% groups of 15–20 has a standard error around ±0.2; meaningful decisions need 100+ examinees, which is why item banks accumulate data across classes and years.
Related calculators
Classical test theory formulas as taught in educational measurement courses (Crocker & Algina, AERA/APA/NCME Standards). They describe a test's statistics for one group of examinees; interpret scores with the test publisher's norms and a qualified educator or psychologist.