From the PARcore Data Visualization Studio Landing Page, navigate to this report by selecting the Reliability Statistics report icon. This report is only applicable for requests that include the Analysis Type of Item Analysis - Classical and include an item analysis with the option to produce reliabilities selected.
The bento box menu icon at the top left of the report can be used to navigate back to the Landing Page.
When first launching the report it will be empty. Make initial filter selections in order to visualize the report. Any filter with a red asterisk indicates it is required to have a selection made before the report can be displayed.
Filters
Refer to Visualize Results for general information about filter navigation for any report. The filters utilized for this report are:
- Analysis - select one analysis sequence number to view at a time. The analysis sequence number will reflect the sequencing from Request Details for this request.
- Upon first initializing this dashboard, the filter will display as (Choose your analysis) and a selection must be made.
- Select the search icon (magnifying glass) and enter search text to see Analysis filter options for the request you are viewing. Using an asterisk in the search text box will display all possible analyses to choose from.
- Once the current analysis results have been reviewed, continue to use the search feature or utilize the slider arrows (< and >) to view each analysis one at a time. If there is only one analysis for this report the navigation buttons will be disabled.
- The criterion score for the analysis will also be included in the filter description.
- Group Type: This is a single select filter to allow users to display reliabilities for each item group.
- Upon first initializing the dashboard, the filter will display as (None), but once the Analysis filter is made the default selection should update to Reliabilities by LIC. If this is not a valid selection for the analysis being analyzed, select a valid entry from the dropdown menu.
- The Group Type menu options are listed based on the analysis selected and the options chosen in your request details. The options are listed in ascending alphabetical order.
- For linear form reliabilities the menu options could be:
- Reliabilities by AU
- Reliabilities by AU within LIC
- Reliabilities by LIC - selected by default
- For ISD reliabilities the menu options could be:
- Reliabilities by AU
- Reliabilities by LIC - selected by default
- Reliabilities by Measure Form
- Reliabilities by Testlet Type
- For linear form reliabilities the menu options could be:
- Use the filter drop down to select each group of statistics you want to review, one at a time.
- Highlight alpha values less than or equal to: Users can choose to enter a threshold value for the visualization to highlight in red font any alpha reliability at or below that value.
- Default selection: 0.80
- To change the highlighted alpha threshold, users can enter a numeric value in the text field and hit the Enter button on the keyboard.
Reliability Statistics Data Display:
- The rows of the table are the statistics for each item grouping within the selected Group Type filter selected.
- If reliability statistics cannot be calculated for any reason, the alpha reliability and any other relevant statistic that cannot be calculated will be displayed as a blank field.
- If the Item Grouping label is so long that the name is not able to fully display in the cell provided an ellipsis should display at the end of the name. Tooltip over the label to see the full non-truncated label. This tooltip will not appear if the label does not require truncation.
- Select each Group Type filter one at a time to see all of the reliabilities calculated for this analysis. Once completed, move to the next analysis (if applicable) using the Analysis filter.