Why Do I Have Empty Cells In Panel Performance (Panelist Agreement)

Why Do I Have Empty Cells In Panel Performance (Panelist Agreement)

The empty cell in the panel/panellist performance is usually due to the fact that you do not have variability in your data (the assessor gives the same score to all the samples).
Indeed, most of the analysis requires dividing by the standard deviation or the variance, and both are equal to 0 when the scores are identical. And dividing by 0 is not really “appreciated” by computers…
 
Note that, at the panellist level, the agreement is measured through the correlation coefficient. And computing the correlation coefficient with two samples is quite critical, as you would need more samples!
More generally, running panel/panellist performance on dataset involving only two samples work from a mathematical point of view, but is not recommended as you would need more samples to get valuable results.
    • Related Articles

    • Why Are The Results From Panel And Panelist Performance Different?

      Although the panel performance and the panellist performance seems to be linked, at least from an interpretation point of view (one could expect that the panel is discriminating if panellists are discriminated), the analyses involved different data ...
    • Panelist Performance Analysis

      Purpose This analysis looks at the overall panel performance in terms of Discrimination, Agreement and Repeatability or Reproducibility, and then the performance of each individual in the panel in these terms. Data Format See the profiling dataset. ...
    • Panel Scheduling in EyeQuestion 5

      Introduction One of the more challenging tasks in conducting sensory and consumer research is the process of manually checking the availability of your panellists participation by calling or emailing them. This traditional approach is not ideal as it ...
    • Export Accounting (Panelist History)

      If you want to create an overview (in Excel) of your projects and participants or of your panelist' participation, then the Export Accounting is the way to go. Go to Tools > Data tools > Export Accounting Use the filters to filter on date or time ...
    • Panel Management

      Introduction The Panel Functionality empowers users to send emails or notifications to panellists for diverse objectives, such as inviting them to schedule appointments, directly fill in questionnaires, or deliver general messages. Additionally, ...