Review drafts are computer printouts of test items and item history data organized by subject category. The items are of three types: Multiple Choice, True False and Alternate Choice (two response options). Prior to requesting review drafts, it is assumed that the user has conducted sufficient job analysis to facilitate the development of a test plan and the identification of appropriate subject areas to be measured.

Review Draft Requests
To obtain Review Drafts, the WRIB Services Request Form: Review Draft needs to be completed. Much of the form is self explanatory; however, there are a few items that require further discussion:

Date Needed by
The date the test materials need to be received by the user should be indicated in this space. When indicating request date, WRIB members should allow five (5) working days, in our office, for processing requests. WRIB requests are prioritized by the date received and the date they are needed by the user.

WRIB Code
The WRIB Job Classification System was developed to provide a common job classification code for use in labeling the item analysis history records for WRIB items. This enables WRIB users to evaluate an item's performance relative to the applicant groups to which it has been administered. As substantial item history data are developed, the WRIB Codes enable computer search based specifically upon prior test administrations for classifications comparable to the job classification for which a review draft has been requested. The four digit WRIB code describes four different characteristics of a job classification that can influence the performance of the applicant group responding to an item. These characteristics are occupational area, functional area, level of supervision received/exercised, and minimum educational requirements of the classification. Each of these characteristics constitutes one digit of the code. The definitions of each digit are contained in the WRIB Job Classification System.

Category Codes
The Request Form also indicates that category codes are required for item selection. The category code represents an item taxonomy used to specify the subject for which items are requested. The taxonomy consists of three digit numerical codes. Each category code has a title and most have been defined. The taxonomy is provided to members in two formats, by category number (Test Item List, Category Order), in ascending order, and by category title (Test Item List, Title Order), in alphabetical order. In each format, the following information is provided: category code number (CAT); the total number of items in the category (TOT); the number of items for each item type (MC, TF, AC), and the definition or comments about the category.

The most effective method of category selection is to begin by locating the subject of interest in the Title Order printout. The category code should then be used to refer to the Categorical Order of the taxonomy. The categories are numbered such that related subjects are clustered. Thus, additional relevant categories are easily identified. After selecting the appropriate categories, list the code numbers on the request form and indicate the number of items desired.

WRIB Clusters
The WRIB Clusters represent a group of items on a related subject that may include a common premise, set of instructions, or a reading passage.

This enables WRIB users to select items that are most closely related to the area of interest. The WRIB clusters are provided in category order, followed by an item cluster ID, the number of premises and items, and a cluster title and definition. Some clusters are complete, separately timed sections, e.g., filing (750) and proofreading (953) sections. These clusters have the time limit indicated in parentheses under the cluster definition.

The most effective method of selecting clusters is to begin by locating the subject of interest in the Title Order printout of the taxonomy. Then refer to the WRIB Cluster Definitions list by category order to identify clusters of items most relevant for the current classification.

Number of Items Desired
As a general rule, it is best to request twice as many items for each category as your test plan calls for. This permits review by local subject matter experts to identify which items are most appropriate for your particular job classification. Since few written examinations contain more than 150 items, a request for a review draft generally should not exceed 300 items. However, exceptions may be made when a request is to create a test for more than one job classification, develop alternate forms of a test, or if extensive subject matter expert review and feedback will be provided.

Supporting Documents

WRIB Job Classification System  

Utilizing Item History from Review Drafts