Forced Distribution of Responses: Survey Example
Have you ever noticed that sometimes a participant will rate all items as extremely high or extremely low. This type of rating could be a form of "Rater Bias".
This is an example of how a questionnaire form can limit the number of a specific type or class of ratings that a participant can make. In this sample questionnaire, there are 4 competencies. Within each competency, there are 5 items (statements) that must be rated using a 3-point rating scale. However, the computer will only allow 5 ratings of "Great" for the entire form. You can rate any of the items however you want. However, you can only rate no more than 5 items as "Great". The computer will also limit you to no more than 5 "Could Improve" ratings.
Try it. Try to select more than 5 of the "Great!" or "Could Improve" ratings. As soon as you select 5, you will be prevented from selecting more. This is all automatic. Isn't this "Great!"?
In the form below, you need to select a combination of ratings (some high and some low). You cannot select the highest rating or the lowest rating for all of the items.