Question 1

Bloom's (1956) taxonomy for categorizing the level of item abstraction had a major impact on test development. Identify and define the 6 levels of Bloom's taxonomy.

Accepted Answer

Knowledge - items a concrete and include memorization of fact
Comprehension - items assess understanding and interpretation of information
Application - items measure a test taker's ability to use information to solve novel problems
Analysis - items assess the test taker's ability to see patterns and organize components of the whole
Synthesis - items assess the test taker's ability to draw appropriate conclusions form information and to use old items to create new ones
Evaluation - items at the highest level of abstraction require test takers to compare and discriminate between ideas

Question 2

Compare and contrast the advantages and disadvantages of multiple-choice and short answer / essay items in the construction and administration of a classroom test.

Accepted Answer

A multiple-choice test is more difficult to create initially than most short answer / essay exams, but is much easier to grade. Short answer / essay more readily allow for testing of higher-order cognitive objectives (though multiple-choice items are capable of this too). Even with scoring rubrics, short answer / essay exams require some level of subjectivity in scoring. Constructed response items like short answer / essays take longer to administer per item, thus the tests are usually composed of fewer items, which can be a challenge for fully capturing the content domain.

Question 3

In creating an essay for the midterm exam of her Education course, Isis asked students to compare and contrast two approaches to pedagogy. The exam question most likely was at the ________ level of cognitive abstraction according to Bloom's (1956) taxonomy.

Accepted Answer

A)   application
B)   analysis
C)   evaluation
D)   knowledge C

Question 4

A test of maximal performance examines performance when test takers are ________.

Accepted Answer

A)   engaging in challenging physical tasks
B)   highly motivated
C)   asked to achieve optimal efficiency
D)   tested under conditions of significant duress

Question 5

What does the concept of "test-wiseness" refer to? What is the possible impact of test-wiseness on the validity of test scores?

Accepted Answer

The answer of What does the concept of "test-wiseness" refer...

Question 6

Examination of ________ would be inappropriate for a speed test.

Accepted Answer

A)   predictive criterion-related validity
B)   concurrent criterion-related validity
C)   test-retest reliability
D)   internal consistency reliability

Question 7

Janet complained that most of her Medical Terminology course was mere rote memorization. Her complaint would indicate that the level of Bloom's (1956) cognitive abstraction focused on in the course was primarily ________.

Accepted Answer

A)   application
B)   analysis
C)   evaluation
D)   knowledge

Question 8

A major difference between large-scale test development and classroom test development is that in the classroom ________.

Accepted Answer

A)   subject matter experts are more likely to review the items
B)   item modification commonly precedes test administration
C)   item statistics are typically computed prior to test administration
D)   pre-testing is rarely performed

Question 9

Students in Ms. Urizar's 4th period Spanish class were provided the entire 50-minute class period to complete the vocabulary test, although most students were able to complete the exam in 30 minutes. This Spanish test is an example of a ________.

Accepted Answer

A)   speed test
B)   power test
C)   combination speed and power test

Question 10

Teachers often allow students to choose from among several essay questions on a test. Provide a rationale as to why this is, or is not, a good practice in testing.

Accepted Answer

The answer of Teachers often allow students to choose from...

Question 11

In writing multiple-choice items, use of the response option "None of the above" should be________.

Accepted Answer

A)   included only when it is the correct response
B)   never included
C)   included only if it is sometimes the correct response
D)   always included

Question 12

Fives and DiDonato-Barnes (2013) proposed a(n) ________ to act as a blueprint for the development of a classroom test to help ensure the test assesses an adequate sample of content across the desired levels of cognitive complexity.

Accepted Answer

A)   Table of Specifications
B)   revision to Bloom's taxonomy
C)   replacement of Bloom's taxonomy
D)   Educational Checklist

Question 13

Discuss 3 changes proposed by Anderson and Krathwohl (2001) to Bloom's (1956) original taxonomy. Explain how you think these revisions improve on the original taxonomy.

Accepted Answer

The answer of Discuss 3 changes proposed by Anderson and...

Question 14

When scoring short answer or essay items, reading several responses before assigning grades can ________.

Accepted Answer

A)   introduce criterion contamination
B)   improve future item development
C)   increase scoring reliability
D)   eliminate scoring biases

Question 15

A multiple-choice question is a common example of a ________ item.

Accepted Answer

A)   selected response
B)   fill in the blank
C)   free response
D)   constructed response

Exam 12: Developing Tests of Maximal Performance