Through our digital agency pedigree, we have learned a lot about how people act on surveys. When you are asking real people to answer questions there is always a risk for some kind of sampling bias. Thus, we have worked hard to design our invitation pop-up to maximize participation and data quality. Here are some of the principles Task Analytics applies:
- Capture the response as close as possible to the experience. Make it easy for users to immediately participate without having to seek out a way to respond.
- Keep the invitation pop-up short. Our tests shows that most people drop off after 4 - 5 questions. At that point, most people click away or blindly click through any and all questions in hopes of an award.
- Don't use awards to drive participation. With a "tangible" award, there is always a chance that the respondent cares more about the award than giving honest feedback. The only award should be the privilege of impact.