From the PARcore Data Visualization Studio Landing Page, navigate to this report by selecting the Problem Item Report report icon in the Item Analysis-Classical  section.   This report is only applicable for requests that include the Analysis Type of Item Analysis - Classical and had at least one item that received an item-level flag.  

The bento box menu icon at the top left of the report can be used to navigate back to the Landing Page.
 




When first launching the report it will be empty.  Make initial filter selections in order to visualize the report.  Any filter with a red asterisk indicates it is required to have a selection made before the report can be displayed.


Filters
Refer to Visualize Results for general information about filter navigation for any report.  The filters for this report are:



 

• Analysis - select one analysis sequence number to view at a time.  The analysis sequence number will reflect the sequencing from Request Details for this request.
  • Upon first initializing this dashboard, the filter will display as (Choose your analysis) and a selection must be made.  
  • Select the search icon (magnifying glass) and enter search text to see Analysis filter options for the request you are viewing.  Using an asterisk in the search text box will display all possible analyses to choose from.
  • Once the current analysis results have been reviewed, continue to use the search feature or utilize the slider arrows (< and >) to view each analysis one at a time.   If there is only one analysis for this report the navigation buttons will be disabled.
  • The criterion score for the analysis will also be included in the filter description.

• Report View:  This is a single-select filter and allows users to select one or two reports to view.   
  • Upon first initializing this dashboard, the filter will display as (None) but should become populated once an Analysis filter selection is made. 
  • The possible report view options are:
    • Problem Item Summary (selected by default)
    • Possible Mis-key Report (if available)
  • The Problem Item Summary report view will display all the item flags that were identified in this analysis along with a summary of how many items received each flag.
  • The Possible Mis-key Report is only available to be selected if this analysis contained at least one dichotomous item a D, S, M, or P flag.  This report will display response-level statistics for any item with one of those relevant flags. 

       



Problem Item Report Display:
 

• A list will be displayed of all flags triggered in this analysis.   The table displays the following information for the flags:
  • A description of the flag, including the flag letter designation commonly used in various reports.
  • The user-selected criterion for the flag. 
    • When applicable, the criterion will include both the Group By value and statistic value selected and entered into the analysis template section for flag items.  
  • The number of flagged items and percent of total item that triggered this flag for this analysis.

• A flag is only included in this report if at least one item met the flagging criterion.  In cases where a given flag has more than one flagging criterion defined in the analysis template (such as separate criterion for Dichotomous and Polytomous) only the flagging criterion that has been met will be displayed.

 
Possible Mis-key Report Display:
 

• Dichotomous items with any single or combination of D, S, M, or P flags are included in this report of possible mis-key items.  The report displays the following information for any dichotomous item with at least one of those flags:
  • The item information (accession number, sequence, assembly unit information)
  • The relevant flag that was triggered and which distractor response(s) triggered the flag(s).
  • The key response value.
  • The distractor response values that triggered at least one of the four relevant flags.
  • The Percent Choosing and Correlation with Criterion relevant to each displayed response.
    • These response-level statistics are for the All Test Taker group as opposed to the High Ability group if referring back to the Item Response Curve report for this item. 

• A distractor may have a blank value for Percent Choosing and for the Correlation with Criterion if that response was not one of the popular wrong responses across, as defined in the analysis template value for the option Max Popular Wrong Responses.  If a response was not one of the popular wrong responses in the All Test Taker group, even if it is popular among the High Ability group, we cannot display the percent choosing or correlation.