8 Tips for Creating the Perfect Online Survey

You put a survey online, 60 people took part, and you still cannot do much with the answers? That is rarely down to the people who responded. It usually comes down to three or four decisions made while the questionnaire was being built.

A successful online survey comes from deciding, before you write a single question, what decision you want to make at the end, keeping the questionnaire to 10 to 15 minutes, asking about only one thing per question, keeping the answer options free of overlap, and having three people who do not know your topic fill in the draft before you send it. For this article we went through the methodological literature on questionnaire length and data quality and brought back the numbers.

---

📌 The key points at a glance

• Ideal length of an online survey: 10 to 15 minutes.
• Every question asks about exactly one thing, never two.
• Answer options must be complete and free of overlap.
• Attention traps also discard usable answers, says Leiner (2019).
• A pretest with three strangers finds most mistakes.

---

What makes an online survey work

A survey is successful when it lets you answer a question you could not answer before. Not when lots of people took part. A study with 40 clean answers to one clear question is worth more than 400 answers to a questionnaire that asks about everything a little bit.

That is why it pays to work through the tips below by impact rather than in order. The biggest losses happen early: with the goal, the length and the wording. Survey tools such as Google Forms, SurveyMonkey or empirio.ai will assemble the questionnaire for you, but none of them checks whether your questions are the right ones.

Your situation	What matters first
Survey for a thesis	clear research question, careful wording, documented sample
Customer survey at work	short length, concrete questions, one free-text box at the end
Survey in a club or student organization	few questions, phone view, a clear invitation
Quick opinion poll for an article	neutral wording, balanced options, stated limits

The eight tips cover the whole route, from the goal question to the analysis. If you are planning the structure at the same time, the detailed guide on creating a questionnaire helps with the individual sections.

Tip 1: Start with the goal question, not the questionnaire

The goal question is the single sentence you want to answer once the results are in. It comes before the first questionnaire item, not after. Without it you almost automatically end up with a questionnaire that touches twenty interesting things and settles nothing.

Take an example from a sports club: “Should we move the summer party to a Saturday?” is a goal question. “What do members think about the summer party?” is not. The first version tells you which questions you need, namely availability on Saturdays, travel time and childcare commitments. The second version invites you to simply ask everything.

The test for this takes two minutes. Take every question in your draft and say out loud what you will do if 70 percent answer one way and 30 percent the other. If nothing comes to mind, the question can go. In a first draft this often removes a third of the questions, and the survey gets noticeably shorter.

Any question whose answer changes nothing costs you respondents and gives you nothing.

Tip 2: How long should an online survey be?

An online survey should run for roughly 10 to 15 minutes, and the point at which respondents lose patience sits at around 20 to 25 minutes. These figures come from Melanie Revilla and Jan Karem Höhne (2020), who asked about 7,800 people in two German online panels directly about the ideal and the maximum length. Fieldwork ran in July and August 2019 and the study appeared in the International Journal of Market Research.

Comparable figures for the United States do not exist. An earlier study by Revilla and Carlos Ochoa (2017) in Mexico arrived at a median ideal length of 10 minutes and a median maximum of 20 minutes, so the range holds across very different markets. As a planning figure it is solid enough.

You will often read that a survey must never exceed five minutes. That only holds for quick polls among friends. For a study with a real research question you are giving away content that respondents would happily grant you. What matters is not the number of minutes alone, but whether the length suits the occasion and whether you state it honestly in advance.

Occasion	Realistic length	Number of questions
Quick poll among friends	under 2 minutes	3 to 5
Customer survey	3 to 5 minutes	8 to 12
Survey for a thesis	10 to 15 minutes	20 to 35
Employee survey	10 to 15 minutes	25 to 40

Guide values, calculated at roughly 20 to 30 seconds per question. As of August 2026.

Length works on you twice over. Mirta Galesic and Michael Bosnjak (2009) told respondents their questionnaire would take 10, 20 or 30 minutes. The longer the stated length, the fewer people started at all and the fewer reached the end. Questions placed later were also answered faster, more briefly and more uniformly than the same questions at the start (Public Opinion Quarterly).

Two things follow for your survey. State the duration honestly, because a flattering estimate only pushes the drop-offs further back instead of preventing them. And put the questions your analysis depends on in the first half.

Tip 3: Write questions everyone reads the same way

A good survey question is understood the same way by every respondent and can be answered without thinking about the wording. Timo Lenzner and Natalja Menold set out the rules for this in the GESIS Survey Guidelines (2015), published by the German social science institute GESIS. Most mistakes in everyday surveys break exactly four of them.

Rule	Better not like this	Better
One thing per question	“How happy are you with price and service?”	ask two separate questions
No double negatives	“Are you against keeping the ban?”	“Are you in favor of a ban?”
No leading wording	“Do you also think the fee is too high?”	“How do you rate the level of the fee?”
A clear time frame	“Have you been to the club recently?”	“Have you been to the club in the past four weeks?”

A fifth mistake escapes almost every guide: the unbalanced either-or question. “Do you think all members should take a turn on duty?” names only one of the two options out loud. According to Lenzner and Menold, the option that is spelled out then attracts more agreement than the one left unsaid. The fix is unglamorous: write out both sides, so “… or should that be left to each member to decide?”.

💡 Tip

Read every question out loud and notice where you stumble. That is exactly where the person filling in your survey will stumble too. Nested clauses and words like “where applicable” give themselves away in seconds.

Which question type suits which piece of information is a decision of its own. An overview with examples is in the question types for questionnaires and surveys, and the trade-off between free text and fixed options sits with open and closed questions.

Tip 4: Keep answer options complete and free of overlap

Answer options have to meet two conditions: they cover the whole range, and no two options overlap. The classic breach of the second one is age bands such as “20 to 30” and “30 to 40”. Anyone who is 30 can check both, and the analysis of that question is ruined.

Completeness is the less obvious condition. If the option a person would actually choose is missing, one of two things happens: they skip the question, or they check something at random. Both distort your result, and in the second case you never notice. An “Other” field with a text line costs you nothing and catches exactly those cases.

When a “don’t know” option makes sense

A “don’t know” option belongs anywhere the respondent genuinely cannot know the answer. For knowledge questions and for topics that do not affect everyone it is essential. For attitude questions it is a convenient escape route: anyone who would rather not commit takes it, and you lose the information. Rule of thumb: offer it where not knowing is realistic, otherwise put a filter question in front instead.

Odd or even scales for rating questions

An odd scale with five or seven points has a real middle, an even scale with four or six points forces a direction. Both are legitimate, they simply measure different things. If a neutral position is a valid answer, use the odd scale. If you need a direction, for example when measuring satisfaction, the even scale is the more honest choice. What matters most is sticking to one form within a single questionnaire.

Why the order of answer options counts

In lists people click, the options near the top get chosen more often than those further down. Lenzner and Menold describe this primacy effect for visual presentation; when options are read aloud it reverses and the last items win. So never sort options by your own preference. Where there is no natural order, a randomized sequence helps, and many survey tools offer it as a setting.

How to label scales and how many points suit which question is covered in detail under rating questions in questionnaires and surveys.

Tip 5: Plan the order of your questions deliberately

The order of the questions helps decide how good the answers turn out. Galesic and Bosnjak (2009) showed that questions at the end of a web questionnaire are answered faster, more briefly and more uniformly than the same questions at the beginning. The last questions therefore systematically get the weaker data.

A plain running order follows from that. What you really need goes to the front. What would merely be nice to know goes to the back. Demographics such as age, gender or major belong at the end, because they persuade nobody to take part and are still filled in reliably down there.

1. Opening question. Easy, concrete, answerable without thinking.
2. Core questions. The ones your analysis depends on.
3. Depth. Detail questions, free text, special cases.
4. Demographics. Age, gender, role, only if you will analyze them.

There is one exception: filter questions. If part of your questionnaire applies only to certain people, the filter question has to come before that part. So ask “Were you at the summer party?” first and show the detail questions only to those who said yes. That spares you jumps back and forth in the questionnaire.

Which demographics you need at all is also a privacy question. Every extra detail shrinks the group a single person disappears into. The demographic questions in surveys go into that in detail, and how participation stays genuinely anonymous is covered under anonymous surveys.

Tip 6: Have the questionnaire tested before you send it

A pretest is the single most effective step before sending, and the one most often skipped. Three to five people who do not know your topic fill in the questionnaire while you sit beside them or stay on the phone. They tell you, question by question, how they understood it.

The trick lies in the question you ask them. “Is that clear?” gets you nowhere, because everyone politely says yes. “What exactly do you mean by your answer?” and “What did you understand this question to be asking?” bring the misunderstandings out. In survey methodology this is called a cognitive pretest, and the GESIS Survey Guidelines list it as standard practice.

Checklist before you send

The points below can be checked in ten minutes and catch exactly the mistakes that cannot be fixed afterwards. Go through them once in full before you share the link.

• Every question asks about exactly one thing.
• No answer category overlaps with another.
• The questionnaire works on a phone without sideways scrolling.
• The filter logic never jumps backwards.
• The stated duration matches your test run.
• The privacy notice sits before the first question.

Many people underrate the privacy notice. Which rules apply depends on where your respondents live, from state privacy laws in the US to the GDPR for anyone in Europe, and in every case you need a short, readable note on what you store and why. Which details count as personal data is covered under data protection in surveys.

⚠️ Watch out

A test run with yourself does not count. You know the questions, you no longer read them, and you need about a third of the time. Take the duration from a stranger’s test run and round it up before you quote it in the invitation.

If you are starting from scratch, ready-made question sets save you the first draft. Our survey templates and examples are made to be adapted rather than copied unchecked.

Tip 7: Get participants and avoid drop-offs

The invitation text decides a large share of your responses. It answers three questions in three sentences: what this is about, how long it takes and what happens to the data. Anything beyond that goes unread, and anything less costs you respondents.

The second lever is timing. A link sent on a Friday afternoon disappears into the weekend, a link sent in the middle of finals week disappears into the panic. Send it when your group is reachable, and plan exactly one reminder after four or five days. Two reminders annoy people more than they bring in.

What belongs in the invitation

✓ The topic in one sentence and the duration in minutes
✕ A long preamble about you, your major and your advisor
✓ What happens to the answers and who gets to see them
→ Only write “no names or email addresses are stored” if that is actually true

How many answers you need depends less on the raw number of respondents than on how they were selected. A survey with 500 answers from an Instagram story describes your followers, not the population. When a study genuinely is representative and when it is not comes down to whether every person in your target group had the same chance of being asked.

There are more routes to respondents than your own contact list. On US campuses, course mailing lists and student organization groups often work faster than social media. Which other channels pay off, and what survey exchange sites really cost you, is covered under how to find participants for your online survey.

Tip 8: Spot useless answers without discarding the good ones

Useless answers are identified most reliably by completion time, not by attention traps. Dominik Leiner (2019) tested experimentally which markers give away carelessly completed questionnaires, and published the raw data alongside. The result is awkward for a lot of survey advice, because it recommends the opposite.

Leiner’s study is freely available in Survey Research Methods. Two points from it matter for your own analysis.

Why attention traps discard too many good cases

The classic trap question (“Please check ‘strongly agree’ here”) looks excellent at first glance. In Leiner’s third study it correctly identified 365 of 368 deliberately careless questionnaires, or 99 percent. But it also flagged 347 of 852 carefully completed ones as useless, or 41 percent. Screening strictly on that basis throws away roughly four out of every ten good answers.

Completion time as the better measure

Leiner proposes a relative speed index instead. You divide the typical completion time of the sample by the time an individual respondent spent per page on average. As a practical threshold he suggests a value of 2.0: anyone who was twice as fast as the rest very probably did not read the questions.

Leiner names one limitation himself, and it matters. For knowledge and factual questions, time is not a valid measure, because people who know the subject simply answer faster than those who do not. Then you are left looking at response patterns: someone who checks the same point twenty times in a rating grid either has very firm views or none at all.

For your analysis that means: do not screen on a single marker, look at the striking cases one by one. And record what you removed and why. In a thesis that documentation is a mark of quality, not an admission.

Common mistakes in online surveys

The four mistakes below turn up in almost every first survey. All four can be fixed in a few minutes before sending, and not at all afterwards.

All four surface as a data problem during analysis, even though they were created while the questionnaire was being built. Once you know the patterns, you usually spot them in your own draft straight away.

The survey measures something other than intended

A question like “How satisfied are you with what we offer?” measures the mood on the day, not the quality of the offer. Anyone who wants to know what specifically bothers people has to ask specifically, so separately about opening hours, price and range. Otherwise all that is left is a pleasant average from which no single action follows.

The questionnaire is unusable on a phone

Wide rating grids with seven columns look fine on a laptop and are barely usable on a phone. A large share of responses comes from phones, though, especially when you share the link through messengers or social media. Open your draft once on your own phone before you send it out.

The analysis was not thought through in advance

Free-text boxes are quick to add and expensive to analyze. With 200 responses, five open questions will cost you several evenings. So plan open questions sparingly, and usually one at the end is enough. For every closed question, work out in advance which analysis you intend to run.

Anonymity is promised but never delivered

“The survey is of course anonymous” sits in the invitation while email collection is still switched on in the tool. When that comes out, trust is gone, and not only for this one study. Check the setting in the tool before you use the word anonymous.

Conclusion

A successful online survey is not a question of the tool but of the groundwork. Clarify the goal question, plan the length honestly, cut every question down to one thing and have strangers fill in the questionnaire once, and you have dealt with the four biggest sources of error. Everything else can be improved as you go.

Where to go next

• Want to build the questionnaire step by step? Creating a questionnaire properly
• Writing a thesis right now? Surveys for a bachelor’s or master’s thesis
• Still looking for the right tool? Survey tools compared

---

Ready for your own survey?

With empirio.ai, an online survey tool from Germany, you build the questionnaire for free and try out logic and design before you share the link.

Create a survey for free