For general instructions, navigating, and actions related to Analysis Templates see Analysis Templates.
The following are details specific to Analysis Type: Item Response Theory - Calibration.
When you are creating, editing, or duplicating an analysis template for Item Response Theory - Calibration, the following sub-menus and options are available:
Processing Options
- Treatment of Omitted Selected Responses
- toggle to exclude or include omitted Selected Responses.
- Treatment of Omitted Constructed Responses
- toggle to exclude or include omitted Constructed Responses.
- Treatment of Not Reached Selected Responses
- toggle to exclude or include not reached Selected Responses.
- Treatment of Not Reached Constructed Responses
- toggle to exclude or include not reached Constructed Responses
Processing Options default selections:
Parameter Specifications
- Newton-Raphson algorithm
- toggle No/Yes
- NOTE: This option is designed to be used when calibrating a relatively small collection of items. The use of this option with a larger item pool may affect running time of the analysis.
- Max Iterations per Stage
- manual entry text box (value must be >= 0)
- Max Iterations for Approximation
- manual entry text box (value must be >= 0)
- Two Stages
- toggle No/Yes
- Convergence Criterion
- manual entry text box (value must be >= 0)
Parameter Specifications default selections:
Quadrature Size
- Number of Quadrature Points
- manual entry text box (value must be > 0)
- Evenly Spaced Grid
- If toggle is set to 'No', no further options are displayed
- If toggle is set to 'Yes':
- Range of Points for Even Spacing
- manual entry text box (value must be > 0)
- Range of Points for Even Spacing
Quadrature Size default selections:
Quadrature Size selections:
Data Specifications
- Number Observations for Starting Iteration
- NOTE: option only available if Parameter Specifications option 'Two Stages' is set to Yes.
- manual entry text box (value must be > 0)
- Assign Group Weights
- If toggle is set to 'No', no further options are displayed
- If toggle is set to 'Yes':
- Groups Weights Table will display
- Group Name
- manual entry text box
- Test Taker Selection Query
- single-select drop down (with search feature) that includes all Test Taker Selection queries configured for the program
- Query type must be Test Taker Selection
- Available values displayed in alphabetical order
- See Queries for additional details.
- single-select drop down (with search feature) that includes all Test Taker Selection queries configured for the program
- Target Percentage
- manual entry text box (value must be > 0)
- Additional groups - when multiple groups are desired, select '+' in the Add/Delete Groups column to add row(s), and populate Group, Test Taker Selection Query and Target Percentage for each group.
- If a group is added, Save will be disabled until all required fields of Group, Test Taker Selection Query and Target Percentage have been filled.
- Once a group row is added, there is a Delete icon (trash can) displayed next to each row in the Add/Delete Groups column. Any row can be deleted. The Delete icon disappears if only one row remains.
- A minimum of one group is required for an Item Response Theory - Calibration template to be saved.
- Group Name
- Groups Weights Table will display
- Use Predictor Vectors for Concurrent Calibrations
- toggle No/Yes
Data Specifications with Group Weights table:
Data Specifications default selections:
Distributions & Summaries
- a parameter
- Lower limit
- manual entry text box (value must be numeric)
- Upper limit
- manual entry text box (value must be numeric)
- Increment
- manual entry text box (value must be numeric)
- Lower limit
- b parameter
- Lower limit
- manual entry text box (value must be numeric)
- Upper limit
- manual entry text box (value must be numeric)
- Increment
- manual entry text box (value must be numeric)
- Lower limit
- Ability
- Lower limit
- manual entry text box (value must be numeric)
- Upper limit
- manual entry text box (value must be numeric)
- Increment
- manual entry text box (value must be numeric)
- Lower limit
- Additional Ability Distributions by Form
- toggle No/Yes
- Additional Item Summaries
- If toggle is set to 'No', no further options are displayed.
- If toggle is set to 'Yes':
- Produce Item Summaries by
- multi-select option to configure if Item Summaries should be complete by Form, AU, and/or LIC.
- Produce Item Summaries by
Distributions & Summaries default selections:
Distribution & Summaries selections:
Plots
- Produce ICC Plots
- If toggle is set to 'No', no further options are displayed.
- If toggle is set to 'Yes':
- Dichotomous Items - 95% Confidence Bands
- toggle No/Yes
- Polytomous Items - Plot Overall ICC Curve
- toggle No/Yes
- Size of Population Marker
- single select option to configure if marker should be proportional to total population at each Ability Group or Constant.
- Dichotomous Items - 95% Confidence Bands
Flag Options
- Flag Items
- If toggle is set to 'No', no further options are displayed
- If toggle is set to 'Yes':
- a parameter
- Dichotomous <=
- manual entry text box (value must be numeric)
- apply flag if result is less than or equal to the entered value
- Polytomous <=
- manual entry text box (value must be numeric)
- apply flag if result is less than or equal to the entered value
- Dichotomous <=
- b parameter
- Dichotomous <=
- manual entry text box (value must be numeric)
- apply flag if result is less than or equal to the entered value
- OR >=
- manual entry text box (value must be numeric)
- apply flag if result is greater than or equal to the entered value
- Polytomous <=
- manual entry text box (value must be numeric)
- apply flag if result is less than or equal to the entered value
- OR >=
- manual entry text box (value must be numeric)
- apply flag if result is greater than or equal to the entered value
- Dichotomous <=
- a parameter
Viewing an Item Response Theory - Calibration analysis template portion displays the options as seen below:
Processing Options & Parameter Specifications
Quadrature Size & Data Specifications
Distributions & Summaries
ICC Plots & Flag Options
For Test Settings details see Test Settings for Item Response Theory
For Request Details information see Request Details
For Statistics and Visualizations available for Item Analysis see Visualize Results
For Statistics Tags definitions and uses see Tagging Statistics