Direct Feedback, Panelist Feedback on a scale, Panelist Feedback

Direct Feedback, Panelist Feedback on a scale, Panelist Feedback

Direct Feedback
The direct feedback function provides the feedback live to panelists. 
The mean and sd need to be specified for each attribute for each product, so you need to know ahead of the mean and the standard deviation value. 
When panelists are filling the questionnaire they will see how their answer performed compared to the mean and the sd set ahead. 

First Create a project: Create Project>Sensory Templates>Panel Training>Direct Feedback



The default template contains already some line-scale that you can modify. 
In the Line Scale Standard used in this template, the Feedback function is already activated (Advanced settings>Feedback). Under mean and sd options you can indicate what mean and standard deviation for each product should be. 

















There are two ways to indicate that:

First methods:
You create and import an Excel file where you indicate the mean and sd value for each product. In the excel file, you need to have a column with the attribute name + mean, and another attribute with the attribute name + sd.  Each row in your excel file corresponds to your products. E.g. 25 is the mean score of product 1 indicated in your design (not the first product that panelists will evaluate).


You can then import this Excel file in Design>Products>Import:



Once imported you will see that the mean and st dev per product are in. If you want you can also directly make the changes here. 



When you go back to your line-scale question, in the mean and sd section you can indicate with a placeholder that the information regarding the mean and sd will be taken from the product characteristics that we just imported. 





Second methods:
Alternatively, you can directly set the mean value and the sd directly from the line scale: in the example below for instance the mean score for product 1 = 40 with sd 5, product 2 = 50 with sd 5 , and product 3 = 60 with sd 5 . 




You can find an explanation of how to use the direct function also in our manual. 

Show how a panelist how he/she rated all the products on the scale (B. Panelist Feedback on a scale): 










1. On your questionnaire, go to the "End screen"  
Add question Panel Feedback>Panelist feedback on a scale 
In the Standard Setting, you should set from which question the feedback is based. 
In this feedback, the panelist will only see their individual personal answer. 


Make sure that the line scale that you use during your test and for your feedback has the same anchor. 


Show the feedback of also the other participants (A. Feedback)
Through this function, you will show the result of EyeOpenR analysis to your panelists.  
In the End Question, add a Question type>Panel Feedback>Feedback.
In the Standard settings, set the Analysis that you would like to show to your panelists. And you can also indicate the Output. 


In the Manual of EyeOpenR you can read more about the different statistical analyses available: https://sites.google.com/a/eyequestion.nl/eyeopener/analysis/panel-performance


    • Related Articles

    • Panelist Feedback Analysis

      Mar 2022 Author: JM Purpose Plots summarising of the scoring range for each judge on each of the samples and attributes. Data Format See the profiling dataset. The attributes should be of scale or interval type. Options Type of Panel Mean: Adjusted ...
    • Panelist Outliers Analysis

      Mar 2022 Author: JM Purpose To detect panellists that are possible outliers, highlighting those with extremely high or low values. Data Format See the profiling dataset. Options Type of Panel Mean: Adjusted or Arithmetic. Arithmetic means are the ...
    • Panelist Performance Analysis

      Mar 2022 Author: JM Purpose This analysis looks at the overall panel performance in terms of Discrimination, Agreement and Repeatability or Reproducibility, and then the performance of each individual in the panel in these terms. Data Format See the ...
    • Panelist Strip Plot Analysis

      Mar 2022 Author: JM Purpose Plots for each attribute the panellists means across the products, for visual comparison and interpretation. Data Format See the profiling dataset. Background This analysis calculates the mean response from each assessor ...
    • Why are the results from panel and panelist performance different?

      Although the panel performance and the panellist performance seems to be linked, at least from an interpretation point of view (one could expect that the panel is discriminating if panellists are discriminated), the analyses involved different data ...