? Imagine you are asked to develop a 20-item multiple-choice knowledge test to measure knowledge of reliability and validity.
? Create a test specification table to guide your development. See For Your Information Box 7.1
? Include the following information in the test specification table:
o Type of test
o Item format
o Test length
o Testing universe
o General content areas and subareas
o Content area or subarea weight
o Number of items per content and subarea
? Write 20-item multiple-choice test items based on the test specification table. Bold the correct response for each item.
? Resource: Test Development, Part One
? Imagine you piloted the test items developed last week with 10 individuals.
? Create a mock data set, based on the pilot. When creating the mock data set, ensure there are some test questions that most individuals answer correctly, some that most individuals answer incorrectly, and some where there are a varied number of correct and incorrect answers. When creating your mock data set, indicate whether each individual answered each question correctly (indicated by a 1) or incorrectly (indicated by a 0) (see sample below).
Question 1 Question 2 Question 3
Individual 1 0 1 1
Individual 2 0 1 0
Individual 3 1 1 0
Individual 4 0 1 1
Individual 5 0 1 0
Individual 6 1 0 1
? Conduct a quantitative item analysis using Microsoft® Excel® or SPSS.
? Include the following:
o Item difficulty
o Item discrimination
o A measure of internal consistency
? Submit your Microsoft® Excel® or SPSS data file and calculations.
? Write a summary of which items you would keep based on the results.
? Include the rationale for your measure of internal consistency, and your rationale for the final items.
The expert examines test development specifications are examined.