The following are details specific to Analysis Type: Item Analysis - Classical.
When you are creating, editing, or duplicating an analysis template for Item Analysis - Classical, the following sub-menus and options are available:
Processing Options
- Combine Item Responses
- single select option to configure if responses should be combined by accession # across forms/AUs or analyze the response within the specific form/AU
- Edit Equivalent Values
- single select option to edit equivalent values by type or value, if required
- Max Popular Wrong Responses
- single selection option to configure the maximum number of wrong responses for calculation and graphing purposes
- Treatment of Omitted Selected Responses
- toggle to exclude or include omitted Selected Responses.
- Treatment of Omitted Constructed Responses
- toggle to exclude or include omitted Constructed Responses.
- Treatment of Not Reached Selected Responses
- toggle to exclude or include not reached Selected Responses.
- Treatment of Not Reached Constructed Responses
- toggle to exclude or include not reached Constructed Responses
- Automated Constructed Response Scoring Contributory Score
- single select option for treatment of automated constructed response scoring contributory score by category weight or precise item score.
The image below shows all default selections for Processing Options:

Correlations & Reliabilities
- Correlation(s) to Compute
- multi-select option for correlations to compute
- Correlation to Use for Flagging
- single select option driven by configured correlations to compute
- Correlation Calculation: Remove Item from Criterion Score
- toggle to remove item from criterion score when calculating the correlation. Option is intended to be used when criterion score is a scaled score.
- Produce Reliabilities
- single select option
- If 'No' is selected, no further options are displayed
- If 'Linear Form' is selected:
- Reliability Calculation Options
- single select option to configure the treatment of omits and not reached for reliability calculation purposes
- Produce Reliabilities by
- multi-select option
- Reliability Calculation Options
- If 'ISD Form' is selected:
- Reliability Calculation Options
- single select option to configure the treatment of omits and not reached for reliability calculation purposes.
- Produce Reliabilities by
- single select option
- ISD Testlets Identified by
- manual entry text boxes to indicate the start position and length of the Testlet Type in AU Test Measure Type.
- Reliability Calculation Options
Produce Reliabilities for a Linear Form:

Produce Reliabilities for an ISD Form:

EIRC & High Ability Group Options
- Produce Smoothed Empirical Item Response Curves
- If toggle is set to 'No', no further options are displayed
- If toggle is set to 'Yes':
- Confidence Shading
- option to configure confidence band around the correct responses in the EIRC curve.
- Additional Partial Credit Item Curves
- if toggle is set to 'No', no further options are displayed
- if toggle is set to 'Yes':
- multi-select option to include optional graphs other than Smoothed % Choosing for partial credit items
- Confidence Shading
- High Ability Group Selection Method
- If 'None' is selected, no further options are displayed
- If 'Constant N%' is selected:
- manual entry text box to indicate the top % to define as the high ability group
- if 'Volume Based N%' is selected:
- table with manual entry text boxes where user can configure different percentages to define the high ability group within specific volume ranges
- '+ Add Range' adds more rows to the table (max of 10)
- Note: N's must be continuous and non-overlapping.
- table with manual entry text boxes where user can configure different percentages to define the high ability group within specific volume ranges
Example with Constant N% for High Ability Group Selection Method:

Volume Based N% for High Ability Group Selection Method:

Validation message for Ns:

Flag Items
If toggle is set to 'No', no further options display.
If toggle is set to 'Yes', all flags are selected by default and pre-populated with default values.
List of flags available (see below list for details on Group By options):
- v - Low N
- manual entry text box (value must be > 0)
- apply flag if sample size does not meet threshold
- r - Low Correlation With Criterion
- manual entry text box (valid values 0.0 - 1.0)
- apply flag if result is less than entered value
- Group by Item Scoring or Response
- A - Low Average Item Score
- manual entry text box (valid values 0.0 - 1.0)
- apply flag if result is less than entered value
- Group by Item Scoring, Response or Number of Choices
- J - Low PPlus
- manual entry text box (valid values 0.0 - 1.0)
- apply flag if result is less than entered value
- Group by Item Scoring, Response or Number of Choices

- H - High Average Item Score
- manual entry text box (valid values 0.0 - 1.0)
- apply flag if result is greater than entered value
- Group by Item Scoring or Response
- Q - High PPlus
- manual entry text box (valid values 0.0 - 1.0)
- apply flag if result is greater than entered value
- Group by Item Scoring or Response
- L - Low Percentage At Score Level
- manual entry text box (valid values 1 - 99)
- apply flag if result value is less than % entered
- Group by Item Scoring or Response

- N - High Percent Omits + Not Reached
- manual entry text box (valid values 1 - 99)
- apply flag if result value is greater than % entered
- Group by Item Scoring or Response
- O - High Percent Omits
- manual entry text box (valid values 1 - 99)
- apply flag if result value is greater than % entered
- Group by Item Scoring or Response
- S - High Ability Group Choosing Distractor
- manual entry text box (valid values 1 - 99)
- apply flag if result value is greater than % entered
- Group by Item Scoring, Response or Number of Choices

- D - High Ability Group Choosing Distractor Over Key
- Group by Item Scoring, Response or Evaluation
- One or two options can be selected within each Group by category
- Option to Include Differences of Distractor and Key proportion that are within a specified % value (valid values 1 - 99)
- M - Mean Distractor Score Greater Than Key
- Group by Item Scoring, Response or Evaluation
- One or two options can be selected within each Group by category
- Option to Include Differences of Distractor and Key Mean that are within a specified value (value must be > 0)
- P - Distractor With Positive Correlation
- manual entry text box (valid values 0.0 - 1.0)
- apply flag if result is greater than entered value
- Group by Item Scoring, Response or Evaluation

Group By options include:
- Item Scoring
- Dichotomous
- Polytomous
- Response
- Selected
- Free
- Evaluation
- Subjective
- Objective
- Number of Choices
- 'Choices <='
- 'Choices ='
- 'Choices >='
- 'Choices N/A'
- Number of choices need to be continuous and non-overlapping
For a list of item types included in each classification see Flags and Automated Comments - Psychometric Analysis and Research Statistical Analysis Engine - Confluence (ets.org)
Delta Options
- Compare Deltas
- If toggle is set to 'No', no further options display.
- If toggle is set to 'Yes':
- Option to select 'Equate Item Statistics' in Test Settings is removed.
- When using a template with Compare Deltas to generate a request, a warning will display in Request Details prompting the user to import a file with Reference Delta values to use in the comparison. See Request Details for more information.

Statistics Tags
Once all required selections in the Analysis Template tab have been entered, the Statistics Tags tab becomes available.
- Item Analysis - Classical templates have item-level tags and test-level tags available to be configured.
- Tags selected in the analysis template are the default tags used in an analysis request using that template. Tag overrides can be performed for the following:
- By analysis or LIC in Test Settings (BEFORE a request is generated). See Test Settings for Item Analysis - Classical for more information.
- By item (selecting by item, LIC, or AU) in Tag Statistics (AFTER a request is run). See Tag Statistics for more information.

Viewing an Item Analysis - Classical analysis template displays the options as seen below:
Processing Options

Correlations & Reliabilities


EIRC & High Ability Group Options

Flag Options



Delta Options

In the Statistics Tags tab:
- Check marks show default item-level and test-level tag selections configured during template creation.

For Test Settings details see Test Settings for Item Analysis - Classical
For Request Details information see Request Details
For Statistics and Visualizations available for Item Analysis see Visualize Results
For Statistics Tags definitions and uses see Tagging Statistics