For general instructions, navigating, and actions related to Analysis Templates see Analysis Templates.

The following are details specific to Analysis Type: Item Response Theory - Calibration. 


Calibration - landing


When you are creating, editing, or duplicating an analysis template for Item Response Theory - Calibration, the following sub-menus and options are available:  

Processing Options

  • Treatment of Omitted Selected Responses
    • toggle to exclude or include omitted Selected Responses.
  • Treatment of Omitted Constructed Responses
    • toggle to exclude or include omitted Constructed Responses.
  • Treatment of Not Reached Selected Responses
    • toggle to exclude or include not reached Selected Responses.
  • Treatment of Not Reached Constructed Responses
    • toggle to exclude or include not reached Constructed Responses

Processing Options default selections:

Calibration - processing options


Parameter Specifications
  • Newton-Raphson algorithm
    • toggle No/Yes
    • NOTE: This option is designed to be used when calibrating a relatively small collection of items. The use of this option with a larger item pool may affect running time of the analysis.
  • Max Iterations per Stage 
    • manual entry text box  (value must be >= 0)
  • Max Iterations for Approximation
    • manual entry text box  (value must be >= 0)
  • Two Stages
    • toggle No/Yes
  • Convergence Criterion
    • manual entry text box  (value must be >= 0)

Parameter Specifications default selections:


Calibration - parameter specifications



Quadrature Size 
  • Number of Quadrature Points
    • manual entry text box  (value must be > 0)
  • Evenly Spaced Grid
    • If toggle is set to 'No', no further options are displayed
    • If toggle is set to 'Yes':
      • Range of Points for Even Spacing
        • manual entry text box  (value must be > 0)

Quadrature Size default selections:


Calibration - quadrature size default


Quadrature Size selections:


Calibration - quadrature size



Data Specifications 
  • Number Observations for Starting Iteration
    • NOTE: option only available if Parameter Specifications option 'Two Stages' is set to Yes.
    • manual entry text box  (value must be > 0)
  • Assign Group Weights
    • If toggle is set to 'No', no further options are displayed
    • If toggle is set to 'Yes':
      • Groups Weights Table will display
        • Group Name
          • manual entry text box
        • Test Taker Selection Query
          • single-select drop down (with search feature) that includes all Test Taker Selection queries configured for the program
            • Query type must be Test Taker Selection
            • Available values displayed in alphabetical order
            • See Queries for additional details.
        • Target Percentage 
          • manual entry text box   (value must be > 0)
        • Additional groups - when multiple groups are desired, select '+' in the Add/Delete Groups column to add row(s), and populate Group, Test Taker Selection Query and Target Percentage for each group.
          • If a group is added, Save will be disabled until all required fields of Group, Test Taker Selection Query and Target Percentage have been filled.
          • Once a group row is added, there is a Delete icon (trash can) displayed next to each row in the Add/Delete Groups column.  Any row can be deleted.  The Delete icon disappears if only one row remains.
          • A minimum of one group is required for an Item Response Theory - Calibration template to be saved.
  • Use Predictor Vectors for Concurrent Calibrations
    • toggle No/Yes

Data Specifications with Group Weights table:


Calibration - data specifications


Data Specifications default selections:


Calibration - data specifications default 


Distributions & Summaries 
  • a parameter
    • Lower limit
      • manual entry text box  (value must be numeric)
    • Upper limit
      • manual entry text box (value must be numeric)
    • Increment
      • manual entry text box (value must be numeric)
  • b parameter
    • Lower limit
      • manual entry text box  (value must be numeric)
    • Upper limit
      • manual entry text box  (value must be numeric)
    • Increment
      • manual entry text box  (value must be numeric)
  • Ability
    • Lower limit
      • manual entry text box  (value must be numeric)
    • Upper limit
      • manual entry text box  (value must be numeric)
    • Increment
      • manual entry text box  (value must be numeric)
  • Additional Ability Distributions by Form
    • toggle No/Yes
  • Additional Item Summaries 
    • If toggle is set to 'No', no further options are displayed.
    • If toggle is set to 'Yes':
      • Produce Item Summaries by
        • multi-select option to configure if Item Summaries should be complete by Form, AU, and/or LIC.

Distributions & Summaries default selections:


Calibration - distribution ranges default


 Distribution & Summaries selections:


Calibration - distribution ranges



Plots 
  • Produce ICC Plots 
    • If toggle is set to 'No', no further options are displayed.
    • If toggle is set to 'Yes':
      • Dichotomous Items - 95% Confidence Bands 
        • toggle No/Yes
      • Polytomous Items - Plot Overall ICC Curve
        • toggle No/Yes
      • Size of Population Marker
        • single select option to configure if marker should be proportional to total population at each Ability Group or Constant.
Plots default selection:


Calibration - icc plots

Flag Options
  • Flag Items
    • If toggle is set to 'No', no further options are displayed
    • If toggle is set to 'Yes':
      • a parameter
        • Dichotomous <= 
          • manual entry text box   (value must be numeric)
          • apply flag if result is less than or equal to the entered value
        • Polytomous <= 
          • manual entry text box   (value must be numeric)
          • apply flag if result is less than or equal to the entered value
      • b parameter
        • Dichotomous <= 
          • manual entry text box   (value must be numeric)
          • apply flag if result is less than or equal to the entered value
          • OR >=
          • manual entry text box   (value must be numeric)
          • apply flag if result is greater than or equal to the entered value
        • Polytomous <= 
          • manual entry text box   (value must be numeric)
          • apply flag if result is less than or equal to the entered value
          • OR >=
          • manual entry text box   (value must be numeric)
          • apply flag if result is greater than or equal to the entered value
 

Calibration - flags



Viewing an Item Response Theory - Calibration analysis template portion displays the options as seen below:

Processing Options & Parameter Specifications

Calibration - View 1

Quadrature Size & Data Specifications

Calibration - View 2

Distributions & Summaries

Calibration - View 3

ICC Plots & Flag Options

Calibration - View 4

For Test Settings details see Test Settings for Item Response Theory
For Request Details information see Request Details
For Statistics and Visualizations available for Item Analysis see Visualize Results
For Statistics Tags definitions and uses see Tagging Statistics