Why do I have empty cells in panel performance (panelist agreement) ?

Why do I have empty cells in panel performance (panelist agreement) ?

The empty cell in the panel/panellist performance is usually due to the fact that you do not have variability in your data (the assessor gives the same score to all the samples).

Indeed, most of the analysis requires dividing by the standard deviation or the variance, and both are equal to 0 when the scores are identical. And dividing by 0 is not really “appreciated” by computers…

 

Note that, at the panellist level, the agreement is measured through the correlation coefficient. And computing the correlation coefficient with two samples is quite critical, as you would need more samples!

 

More generally, running panel/panellist performance on dataset involving only two samples work from a mathematical point of view, but is not recommended as you would need more samples to get valuable results.

    • Related Articles

    • Why are the results from panel and panelist performance different?

      Although the panel performance and the panellist performance seems to be linked, at least from an interpretation point of view (one could expect that the panel is discriminating if panellists are discriminated), the analyses involved different data ...
    • How do I interpret panel performance?

      The panel repeatability is evaluated through the product:replicate interaction whereas in the other case (reproducibility), the panel reproducibility is evaluated through the MS error. For individual panelist performance, the agreement is evaluated ...
    • Direct Feedback, Panelist Feedback on a scale, Panelist Feedback

      Direct Feedback The direct feedback function provides the feedback live to panelists.  The mean and sd need to be specified for each attribute for each product, so you need to know ahead of the mean and the standard deviation value.  When panelists ...
    • How can I import a panel?

      You can invite panellists to participate in your panel by: - Transferring them from the Panel Database to the panel access list - Using Import Open a project and click the panel tab. Panelists can be added to the panel by adding them to the access ...
    • What can I do with incomplete sessions?

      A panelist running a test is called a "session". When opening the sessions overview, you will see two kinds of sessions: Open Sessions and Finished Sessions.  An open session means that the panelist started the test, but did not finish the ...