Questionnaires/Surveys/Checklists Guide

Things to Consider

• Who are you planning on surveying?
• How many people are you going to survey?
  • Choose a target number
  • Too few won’t give enough data to support generalizations or findings
  • Too many will overwhelm you with analyzing your data
• How are you going to survey?
  • in person
  • on paper
  • internet
  • should be based on length and types of questions
• How long is your survey going to be?
• What types of questions are you going to ask?
  • open-ended questions allow the participant any type of response (provides richer responses; hard to analyze)
  • closed question sets up possible responses (yes/no, likert scales, specific choices) (easier to analyze but do not provide the rich responses)
• What questions are you going to ask?
  • carefully consider wording
  • consider first sampling a small population to refine question

Designing Questionnaires

1. Theme and cover letter (if mailing)
   1. Theme:
      1. Who you are
      2. Why data is required
      3. Assurance of confidentiality and anonymity (if necessary)
      4. Contact number and/or address
      5. Estimate of completion time
      6. Instructions for return (return date, address)
   2. Instructions for completion
      1. Clear and unambiguous
      2. General instructions (if some questions require specific instructions, separate these)
      3. Response method requested (ex: check, circle, cross out)
      4. Provide examples, if necessary
2. Actual Questionnaire/Survey/Checklist
   1. Appearance
      1. Neat and professional
      2. Careful thought to layout will help your analysis
      3. Simple rules to improve appearance
         1. liberal space make the reading easier
         2. consistent positioning of response boxes (speeds up completion and avoids inadvertent omission of responses)
         3. choose font style to maximize legibility
         4. differentiate between instructions and questions
   2. Length
      1. Excessive size can reduce response rates: be concise!
      2. If long questionnaire is necessary, give more thought to appearance.
   3. Order
      1. Select opening questions with care to keep participant committed
      2. Ask biographical details first
      3. Essential questions early; less important questions towards end
      4. Provoking questions should be asked at end (in the event the participant will not answer)
   4. Coding
      1. If analysis is carried out statistically or with a spreadsheet, design the questionnaire with coding in mind (ex: Male – 1; Female – 2)
3. Questions
   1. Keep questions short, simple and avoid all unnecessary words
   2. Choose words that are familiar to participant
   3. Only ask questions the participants can answer
   4. Avoid hypothetical questions
   5. Avoid calculations and questions that require memory work (ex: How many people stayed in your hotel last year?)
   6. Avoid loaded or leading questions that imply an answer (ex: Do you agree that Starbucks has the best coffee?)
   7. Quantitative statements should be used (ex: avoid words such as “generally”, “usually” or “normally” for more precise meanings)
   8. Questions should only address a single issue (ex: Do you take annual vacations in Ocean City? Should be broken down into two: Do you take an annual vacation? Do you go to Ocean City during that vacation?
   9. Don’t ask two questions in one by using an “and” (ex: Did you watch television and read a newspaper last night?)
   10. Avoid double negatives
   11. State varying degrees (ex: How much did you earn last year? Less than $10,000; More than $10,000 but less than $20,000, etc.)
   12. Avoid emotional or embarrassing word (usually connected with race, religion, policitics, sex or money)
   13. Avoid confusing or wordy questions

• What do you think about parking? (question isn't’t clear)
• Do you believe that the parking situation on campus is problematic or difficult because of the lack of spaces and the walking distances? (wordy and leading)
• What is your opinion of the parking situation on campus? (better option)

Good Websites to gain more insight:

• Innovation Network:  Developing a Survey
• Math is Fun: How to Make Good Survey Questions
• Usability.gov 

Video which explains Survey process:

Help in understanding Statistics, Standard Deviation, etc.:

Samples of Qualitative Survey Questions

The open-ended question seeks to explore the qualitative, in-depth aspects of a particular topic or issue. It gives a person the chance to respond in detail. Although open-ended questions are important, they are time-consuming and should not be over-used. An example of an open-ended question might be:

• What is your favorite subject in school?
• What do you like about __________________?
• How could _______ be improved?

If you want to add an "Other" answer to a multiple choice question, you are adding a qualitative component to a quantitative question.

•  Samples of Quantitative Survey Questions 
•  How often do you use this product?

Example of an online survey

LockMedia Survey Builder

• Sample Calculator

Websites to create surveys:

• Web Online Surveys
• Survey Monkey

Tutorial on using Survey Monkey

Google Groups (access particular online communities)