From the PARcore Data Visualization Studio Landing Page, navigate to this report by selecting the Problem Items report icon.   This report is only applicable for requests that include the Analysis Type of Item Response Theory and include the option to include TBLT analyses.


The bento box menu icon at the top left of the report can be used to navigate back to the Landing Page.
 
Go to landing page



Information about the request that is being viewed are displayed at the top, including the request number, admin, test, form ID or package ID, and user form code. 


When first launching the report it will be empty.  Make initial filter selections in order to visualize the report.  Any filter with a red asterisk indicates it is required to have a selection made before the report can be displayed.


Choose Filters


Screenshot of Analysis Filter


Refer to Visualize Results for general information about filter navigation for any report.  The filter for this report is:
     

  • Analysis - select one analysis sequence number to view at a time.  The analysis sequence number will reflect the sequencing from Request Details for this request.
    • Upon first initializing this dashboard, the filter will display as (Choose your analysis) and a selection must be made. 
      • Select the search icon (magnifying glass) and enter search text to see Analysis filter options for the request you are viewing. 
      • Using an asterisk in the search text box will display all possible analyses to choose from.  
    • Once the current analysis results have been reviewed, continue to use the search feature or utilize the slider arrows (< and >) to view each analysis one at a time.  If there is only one analysis for this report the navigation buttons will be disabled.
    • The analysis template name used for this request analysis will also be included in the filter description.


Navigating Tabs in Tableau:

  • There will be individual tabs to navigate to different reports (Problem Item Report, and Profile Report).  The tab being viewed is displayed in white, with blue-font tab label.  Tabs that are available but not being viewed are pale blue with blue-font tab label.  Click into a tab label to view that report.  You can only view one tab at a time.       
           Tab structure for Problem Items

        

Problem Item Report Tab

If the request options indicate that no flagging is necessary, this report is still produced and displays the Flag column (for both a and b) and the Total Number, but criterion will be blank and the number flagged will always be 0.  

In this tab you are able to see a summary of how many items in the selected analysis were flagged.   The table displays the following information for the flags:
  • A description of the flag, including the flag letter designation.
  • The user-selected criterion for the flag.   
    • In cases where a given flag has more than one flagging criterion defined in the analysis template (such as separate criterion for Dichotomous and Polytomous) only the flagging criterion that has been met will be displayed. 
    • We cannot display the criterion when no items in the data met the flagging criterion.  In those cases the Criterion cell will be "Flagging criterion not available" and the Number of Flagged Items will be 0.  A footnote will also display to clarify that the flagging criterion is not available for display when either (1) no items met the flagging requirement or (2) the flag was not requested as part of this analysis.
  • The total number of items analyzed will be a total of all items regardless of the scoring type (dichotomous or polytomous). 
  • The number of flagged items and percent of total items that triggered each flag for the selected analysis will also be displayed. 
If the request options indicate that no flagging is necessary, this report is still produced and displays the Flag column (for both a and b) and the Total Number, but criterion will not be available and the number flagged will always be 0. 



Profile Report Tab

In this tab you are able to see a table of all items that were flagged.  Only flagged items are included in this report.  The table displays the following information for the flags:
  • Item identifier information, such as the Accession Number, Scoring Version, Sequence in AU, and Assembly Unit Name.
    • Items are sorted and displayed by ascending location number.
    • If an item has more than one assembly unit associated with it, each Assembly Unit and each Sequence in AU for that item will display in the cell for their respective columns.  If the list is so long that all values cannot display in one cell, you can hover over the cell and a tooltip will appear that shows the full list without truncation. The tooltip only appears when the cell values are truncating due to space limitation.
  • Which flag(s) were triggered for the item.  
    • Currently for TBLT users have the option to indicate flagging criterion for only two types of potential problem item flags:  a-parameter flag, b-parameter flag.   
      • Comparison of Parameter Estimates and Comparison of ICC flags are displayed in a separate report.
    • The letter designation for the flag that was triggered will display.  This will be one of the following:
      • a = only the a-parameter flagging criterion was met
      • b = only the b-parameter flagging criterion was met
      • a b = both the a-parameter and b-parameter flagging criterion were met.
  • The a value and b value for the displayed item.

If no flagging was request or if no items met the flagging criterion, a message will display that no items were flagged in this analysis.  

 

Additional statistics are produced and available to users beyond what is presented in the Data Visualization Studio.  Refer to the RTSSTAT API and Download Statistics help documentation for more information regarding accessing all of the available statistics produced.