Advanced Randomization - How to?

Randomization is a research technique that is used to overcome order bias- the bias that can result due to the order of answer choices. Respondents tend to favor choices at the beginning and at the end of a list because they are more memorized. First items may also be chosen by respondents to save time.

Order bias can be taken into account by randomizing the order in which the answer choices are presented.

Go to: Edit » Workspace.

Click on the Settings link for the question.

Under settings, select the Advanced Randomization option under Answer Display Order

Click on Set up advanced randomization

Under Current Display Order you will see your answer options in the default order.

You can select options from current display order and move them to random order or random display using the move options provided.

Once you have setup desired logic, click on save.

All options added under Random Order box will be randomized and displayed to the respondents.

When options are moved to random order, the placeholder will be {random} text.

Random Display allows you to create a sub-set for randomization. For example, you can choose to display N out of M options to randomly display.

Here, we have added Australia, Germany, Japan, and India to this set and want to randomly display 2 options from the 4.

If you wish to not display any of the options, you can add them to excluded items. Options selected for exclusion will not be displayed on the survey.

In research surveys, there are multiple questions with the same set of answer options. Sometimes it is required that the random order used to display the answer options in the first question has to be preserved so the same order is used in the following questions.

This can be achieved using extraction

1. Create the source question and set up randomization using the steps described above.
2. Create the follow up questions using extraction
3. The order from the source questions will be preserved in the extracted questions.