Sometimes, when I read questions in surveys and other forms, I do wonder how important the final data is for the person behind the questions – do they run them for fun rather than as a valid business tool?

Here are two questions I was recently asked to answer – and some tips on how to avoid the same mistakes…

“When will you purchase a new car?
within a  month
1 – 2 months
2 – … months
… – 24 months
never – I don’t purchase new cars”

As we purchased a new car a week ago, I couldn’t give an honest answer to that question – we won’t be buying another within 24 months but ‘never’ is wrong, too.

TIP: make sure you provide an answer for all possibilities, even if one is ‘unsure’ or ‘don’t know’. If your format allows, ‘other’ not only gives options but can gain more insight for you.

“Can you tell us if you are pregnant? Yes No”

Yes I can tell you but the yes answer may mislead you as I’m not pregnant and I assume that’s what you really want to ask me about… I could get really pedantic here and note that I CAN answer but choose not to ( writing ‘please tell us’ or ‘Will you tell us’ are grammatically better than ‘can you tell us’).

TIP: Make sure the question is asking for the information you actually want. In this case, the much simpler ‘are you pregnant?’ would have done the trick.

If you don’t plan your questions carefully, the results you get can be completely meaningless. For example, if 5% of respondents bought a car recently and answered ‘within a week’ you may mistakenly think the next week is prime time to sell a car. There is no way you can tell that someone gave a false answer to compensate for questions they don’t understand/misunderstand/can’t answer.

Depending on how you intend using the answers, skewing results like this can have serious implications. For example, if you plan a marketing campaign and spends thousands of dollars in April when the real results showed September to be effective, you’ve wasted money (in the survey and the marketing). What if you base a new product or pricing structure on the answers collected?

Checking, editing, proof reading and rechecking your questions may seem tedious. The details in faulty questions that I occassionally point out may seem trivial.

The bottom line, however, is that good survey and feedback questions are more fun to answer, give accurate and useful results, and build your credibility (through attention to detail and simplicity for respondents).

I suggest you always get someone else to read your questions before you finalise any form or survey.

“already been attended to by phone or other means would you please advise YES/NO”

How does it help them to know I will (or won’t) advise them on whether my issue has already been dealt with? Wouldn’t the better question be ” Have you already told us about this issue? YES/NO”

Whenever you give people a choice of answers in a survey or form, you have to give answers that actually give the information you are after. Remember that the words ‘would you’ are what people will try to answer, so put them at the start of your question or don’t use them at all.

Generally, use active verbs and phrase questions as simply as possible to avoid confusion and misunderstandings.

PS I could go on to say how important it is to get your promotional materials right – and not use old materials after you make changes. My original complaint was about their promotional brochure offering 4 things in a set but their website offering two things for the same price. Putting these two issues together has totally destroyed that company’s credibility and I don’t trust a thing they say now – and won’t be returning there.

The American Express OPEN small business search marketing survey (March 2011) has a number of statsistics to show where small businesses see online marketing impacting their sales.

While it is a list of survey results (yawn, yawn!) it is a summary so easy to read and can give some useful insights for trends within small business which is useful for comparisons and particularly useful if you sell to that sector. My opening questions are also examples of how you can use this information to assess your own online marketing.

Read the report and let me know what you learn from it…

The question was in effect “Are you primarily a business or personal customer of these services?”

The answer options were “personal/business/equal/I am no longer a customer of Company X”

So the anonymous-to-get-unbiased-answers aspect was thrown out the window with that answer which is not so good. It also didn’t mean a lot as I never said I had been a Company X customer, nor even acknowledged I’d heard of company X before. The fourth answer didn’t even answer the question so was completely irrelevant.

The lesson is to read every answer with the question before you finalise a survey or any other multiple choice list – this also applies for a bulleted list in that each point must complete a sentence from the introduction.

From the above example…

“Are you primarily a business or personal customer of these services?” “personal” works
“Are you primarily a business or personal customer of these services?” “no longer a customer of Company X” doesn’t work.

If you are writing or editing a survey, ensure you read each answer with the question in this way to get a polished, sensible result.

One of the most common questions I have seen in online surveys is the following:

Are you …

male
female?

Technically, the answer is yes  – I am male or female and so is every other human I know of! Fairly pointless question to ask unless you have a third group responding.

In this case, we can see what is really being asked (“which are you?”) and the available answers lead us to answering correctly, but it isn’t always so easy.

It was great recently to be asked to help a major research centre refine their questionnaire. They had determined the questions they wanted to ask but understood that how they asked was critical to the final result of their research.

So if you are preparing surveys or questionnaires, my two key tips are:

• read the questions to make sure the options answer the question and suit your needs
• get at least one other person to read the questions to ensure they make sense to a less involved pair of eyes

Use your words wisely!

In the current global situation, building trust may be even more important.

The Edelman Trust Barometer for Australia is a survey of consumers and how they feel about various institutions. In February this year, they noted a huge 74% decline in trust for business – only 34% of respondents trust a business to do what is right in a specific situation.

What is critical to learn from this survey is the following:

• 87% of Australians will  not buy from a company they don’t trust
• 64% of Australians will pay extra to use a company they do trust
• Australians prefer Australian-owned companies to foreign owned companies as a general rule (obviously that changes in specific situations if the Australian company isn’t trusted)
• corporate advertising is trusted by only 6% of Australians – and corporate websites by only 13%

Some other interesting notes:

• people between 25 and 34 years are twice as likely to share experiences of a company than older respondents
• treating employees well is important – even more important than an environmental commitment – in building trust

As for the survey, it was based on “4,475 upper-income, highly-educated people in 20 countries, including 1,375 in Asia-Pacific countries.”

Apparently, 60% of surveyed small business owners don’t have a website for their business. That is incredible. They surveyed 1,503 business owners with no more than 19 employees, so it is a reasonable number but perhaps not statistically significant compared to how many small businesses there are in Australia.

Not all businesses are internet based, obviously, but offline businesses can have a website and use it to good effect.

Why am I so surprised they don’t have a website?

• personally, I often refer to the website for further information or to get a feel for a business before I contact them – no website and there’s a good chance I’ll move on. This is especially true now I have a baby as it is easier to research and compare from home than to drive around
• a website is like a brochure that works 24 hours a day, every day of the year, so why limit yourself to paper?
• a website can be a lot cheaper to run than many traditional advertising options (I pay $5 a month for hosting – you won’t get much advertising for $60 a year!)
• people generally find it easier to remember words than numbers so if you or a happy customer are inviting someone to learn more about your business, a web address could be more successful
• people expect websites now – not meeting that expectation may decrease your credibility in their eyes

A website can be simple and as short as one or two pages; it can be static and need little maintenance (although search engines prefer more active sites). Some online directories offer full page listings which can act as a website, which is better than nothing, but the URL may be long.

SO back to the original question? Do you have a website? Do other business owners you know have websites? If not, why not?

1. Know what you are preparing the survey for – and how you will use the results. By planning the results, you will know what questions you need answered and be sure to word them to get the relevant answers. For instance, if you want to know if clients prefer green or blue so you can change your corporate colours, you won’t bother asking “Do you like pink?”
2. make each question clearly different – if someone has to read a question two or three times to see why it is different to a previous question, they are likely to  give up or answer incorrectly. Be particularly careful to not ask the positive and negative for the same point.
3. don’t just copy the same responses for every question. Yes, it is reasonable to give responses such as excellent and poor to some questions, but not if you ask “did the book help you?” A bit of variety is more interesting and makes it more likely people will read each question properly.
4. check questions follow on from one to the next, especially if you are using software that provides different questions depending on earlier responses. For example, if someone answers “I don’t have children” to question 1, question 2 really shouldn’t ask “how old are your children?”
5. Always provide a response for everyone. It is frustrating for someone who can’t give any of your responses as their answer so always include every option or a way of indicating nothing applies.
6. Make sure every question and provided response makes sense. That means read every question/response pair individually. For example, “was the presentation interesting?” works, “was the presentation informative?” works but “was the presentation expectations?” doesn’t work.
7. every question must be simple and clear – if the question is too complicated you can’t expect useful results. Simplify questions by
   • using simple and short words as much as possible
   • divide a long question into two parts if possible
   • give responses to choose from rather than an open ended question
   • staying to the point – and keeping to your purpose
   • keeping all question short – it’s much easier to complicate 12 words than 6!
8. Always use good grammar and spelling so people aren’t confused or distracted by your errors.
9. Present your survey well so people will actually read and respond to your well written questions!

Ideally, prepare the questions and leave them for a couple of days. Then reread each question to make sure it makes sense and will get the answers you are after. Once you are sure the questions are workable, ask someone else (or a few someone elses) to answer the survey for you and provide feedback on questions they weren’t sure of.

A well written and prepared survey can be a very valuable tool for your business so it is worth putting the time and effort into making it as good as you possibly can.

I just answered a survey that included at least three of the following mistakes and it has left with me with the impression that those business owners don’t care about details or consistency – so why would I trust them with promoting my business (their apparent service)?

So before you make a survey available to your customers, check how it presents and do a test run to see it really does work – better yet, get someone else to do the test run for you.

1. Be careful of what you make a compulsory questions/answer. If a compulsory response isn’t included, the person can’t submit their survey and may get frustrated and move on which means you don’t get their feedback. And most people won’t tell you they had this problem, either.
   So if you do make a question compulsory to answer, ensure there is an answer for everyone so all can answer – even if one answer is “don’t know”, “prefer not to answer”, “none of the above” or similar.
   And if you give a range of answers including ‘other’, make sure that ‘other’ is an acceptable answer. I have done surveys where I can’t submit unless I choose a response instead of ‘other’ – forcing me to choose an inaccurate answer as well as my true comments.
2. Most small (and even larger) businesses use a third party to run surveys. This generally means the survey appears more professional and can be easier to use – for example, not many businesses can afford the programming to do an online survey each time. While this is a valid practice, minimise the third party as much as possible.
   For example, if you complete this business branding survey, which is run on a third party survey site, you will be directed to the host business’s website once you click on ‘submit’. This way, the business itself is being promoted and gains more traffic from people doing the survey. The other option is to let people go to the third party’s homepage once the survey is complete.
3. Brand the survey as much as possible. If the survey is a serious part of your business, it should continue your brand. That means add a logo, use your corporate colours, use the same style of writing, use your corporate fonts and use relevant images as applicable. You may not be able to make it match your web template or change fonts, for instance, but brand it as much as possible.
4. Keep it as short as possible – you probably want responses from a range of people, not just the bored and those who love surveys, and busy people don’t have time for long surveys unless they see a potential benefit from it.
   Be careful with the number of questions – if one more question or comment will create a new page, review it. Someone scanning a survey will see there is another page and decide it is too long which would be a pity if the next page was only one question – or worse, if the next page is simply a “thanks for doing our survey” message.
5. Look at the presentation – is there too much text so it looks complicated or time consuming? Does it look professional or just thrown together? Is there a nice mix of multiple choice answers and written responses, or just written responses? Does it look easy to complete?

Once you are confident you have good questions and a well prepared survey/questionnaire, the next step is to announce and promote it appropriately. Remember that many people won’t fill in the survey just because you want them to – you have to give them a reason to want to do it themselves.

And then make sure you make use of your survey results!

Use your words wisely!

If you are involved in preparing any surveys/feedback forms, it is important to think carefully about how you ask questions. Obviously, the first step is to know what answers you need – do you really want to know how old people are or just the difference between adults and teenagers?

Here are three recent examples I have come across where the question is not going to get the right responses:

“1. Please list as many soft drink flavours you can think of”
“2. For each flavour, please select A, B or C where A is ‘yes, I knew it was a flavour but forgot it’, B is ‘I didn’t realise it was a flavour’ and C is ‘I’ve never heard of it’. {and then list every flavour whether or not the person listed it in question 1}”

So if you had written orange as a flavour in question 1, how can you select A, B or C for orange in question 2? As it was an online survey and answering was necessary, people would guess an answer so the final results mean nothing.

“Were you satisfied with the course handbook?

• excellent
• very good
• good
• ok
• poor”

The options do not answer the question – was I satisfied can only be answered with yes/no/partially. To offer those choices, the appropriate question would be ’How would you describe the course handbook?’

“Which of the following have you ever given your child?

• brand X vitamins
• brand Y multi-vitamins
• brand Z mulitvitamins
• brand XY kids calcium”

Personally, I hadn’t given any of them to my child but there was no option to say ‘none of the above’ or even ‘other vitamins’.

So once you have written any questions, go back and read them in order to see if they make sense and are complete. One way to check multiple choice answers make sense it to add each one to the question so “were you satisfied with the course handbook? excellent” quickly shows an issue.

I’ll go through some tips on writing useful questions soon! In the meantime, what poor survey questions have you noticed or had trouble answering?