Runtime Options (Design)

Runtime Options (Design)

Runtime options are settings that specify how the design is used throughout the project. In most cases the project template contains the correct runtime options for the project you selected. Runtime options can be found in the design of your project.



Settings

Settings are used to let EyeQuestion know which set was assigned to which panellist. For example if you select the setting "by setcode", EyeQuestion matches the setcode the panelist enters to the sample set in the design.

There are 8 possible options:

    1. Automatically - The assignment is done automatically, first panelist to log in receives set 1, panellist 2 receives set 2 etc.

    2. By first sample code - The set is assigned based on the first code entered.

    3. By setcode - The assignment is based on the setcode (three digit blinding code of the set)

    4. By panellist - Link panellists to a set, the assignment is based on panelist login.

    5. By location - Link your sensory booths to sets.

    6. By any sample code - Sets are assigned based on the sample code that was entered by the panellist.

    7. By setnumber - Assignment happens based on the setnumber entered (1 to N).

    8. Inherit from parent project - This option can only be used if the project is a subproject. The assignment of the sets is inherited from the parent project. To learn more about Subprojects read also the article on How to randomize different projects and share them all with one link.

Set validation

Set Validation can be used to confirm if a panelist received the correct set, or if they have the possibility to choose the samples themselves. In general there are 4 options to choose from.
  1. No validation
  2. Confirm sample code

  1. Ask for every sample code

  1. Free Selection
This option will allow your panelists to choose which samples they would like to evaluate and when they want to stop the evaluation.



More information about how to set up a Free Selection questionnaire can be found in the following article:
 Free Selection article

Depending on the settings and the set validation needed, the following combinations can be used:

Settings  Set Validation  Usage   Non recommended to use
 Automatically  Ask for every sample/block code Use when you want EyeQuestion to distribute the sample sets automatically and to ask panelist to enter every sample/block code.  This option is useful when the panellist either pick the sample themselves or if you use the monitor to find out which sample should be served.   
   No validation Set to no validation and your panellist will not be asked to confirm if they received the correct sample. The system assumes the correct sample was served. This combination can be used when there is only one sample in each set.  
   Confirm samplecode Set to confirm samplecode and let the panellist confirm that they have received the correct sample.  
   Ask only first sample/block code Set to ask only first sample/block code to check only if the first sample was served correctly.  
By first sample code Ask for every sample/block code This option can be used when all blinding codes are unique.
The sets are assigned when the panellist enters the first code. However the panellist needs to enter every sample code.
 - When blinding codes are not unique 
 - When your design has more than one session
 By setcode  Ask for every sample/block code Use this option when you provide a three digit code with every set    
(the set blinding code). Set to ask for every sample/block code and ask an additional question where the panellist has to enter their sample code manually. When you use this set up, two questions will be asked. Panellist will first enter their setcode and after that they will enter their sample/block code for each of the samples.
 
   Confirm every sample/block code Set to confirm every sample/block code and let the panellist confirm that they have received the correct sample.  
   No validation Set to no validation and your panellist will not be asked to confirm if they received the correct sample. The system assumes the correct sample was served.   
 By panellist  Ask for every sample/block code Assign a panel to your project. Afterwards, you must link each panelist to a sample set. Each panelist must be linked to 1 set, the system asks for every sample/block code.   - When you use Anonymous link for deploying your project
   Confirm every sample/block code Set to confirm every sample/block code and let the panellist confirm that they have received the correct sample.  
   No validation Set to no validation and panellist will not be asked to confirm if they received the correct sample. The system assumes the correct sample was served.   
 By location  Ask for every sample/block code Use this option when you want to link sets to specific booths. For example panelists that sit in booth 1 will always receive set number 1.  - When your design has more than one session
   Confirm every sample/block code Set to confirm every sample/block code and let the panellist confirm that they have received the correct sample.  - When your design has more than one session
   No validation Set to no validation and your panellist will not be asked to confirm if they received the correct sample. The system assumes the correct sample was served.   - When your design has more than one session
 By any sample code  Ask for every sample/block code Set to by any sample code and let your panellists enter each sample code manually.  - When your design has more than one session
 By setnumber  Ask for every sample/block code Use this option when you provide the set number with every set    
(e.g. 1,2,3,...,n). Set to ask for every sample/block code and ask an additional question where the panellist has to enter their sample code manually. When you use this set up two questions will be asked. They first enter their set number and after that they enter their sample/block code for each of the samples.
 
   Confirm every sample/block code Set to confirm every sample/block code and let the panellist confirm that they have received the correct sample.  
   No validation Set to no validation and your panellist will not be asked to confirm if they received the correct sample. The system assumes the correct sample was served.   
 Inherit from parent project  Ask for every sample/block code When your project is a subproject, the active set can be inherited from the motherproject. If a panellist has set 8 in the motherproject and Inherit from subproject has been set for the subproject, the panellist will also have set 8 for that project. Set to ask for every sample/block code and ask an additional question where the panellist has to enter their sample code manually.  - When your project is not a subproject
   No validation Set to no validation and your panellist will not be asked to confirm if they received the correct sample. The system assumes the correct sample was served.   
   Confirm sample/block code Set to confirm every sample/block code and let the panellist confirm that they have received the correct sample.  
   Ask only first sample/block code Set to ask only first sample/block code to check only if the first sample was served correctly.  

Set order

This setting sets whether the panelist is allowed to evaluate the samples in a different order or that the sequence of the samples is strictly controlled.
It has the following settings:
  1. Free sequence: The sequence doesn't matter. What only matters is whether the code exists in the sample set.
  2. Fixed sequence: The sequence does matter. Codes are accepted only when they are evaluated in the correct sequence.

    • Related Articles

    • Flexible Product Evaluation with Free Selection

      Introduction The Free Selection functionality is designed to enhance flexibility in product validation sessions by giving panellists greater control over their evaluation experience. This feature, available within the "Set Validation" options of the ...
    • Customize Your Design: Runtime Options

      The Runtime Options provides various settings that determine how a design is utilized. These settings can be found under the project design. Generally, the correct setting for the project is included in the project template. However, if you need to ...
    • Workspace: Design Page

      Introduction Welcome to the Design section of EyeQuestion, where the structure of your questionnaire takes shape. This crucial page is where you determine the order in which panelists will evaluate the products. Each template provided within this ...
    • Free Sorting

      Introduction Free Sorting is a simple method for collecting similarity data in which each panellist groups together products based on their perceived similarities. All products are presented simultaneously and randomly displayed. Panelists are asked ...
    • How to Create a Multi-Design Project

      Introduction Multi-design projects serve as tools for conducting comprehensive evaluations across various dimensions. For instance, they prove particularly useful when there's a need to systematically assess different aspects of products. Consider a ...