As I mentioned in last week’s survey invitation, when you’re trying to build a business, blog, non-profit, or pretty much any venture, regularly checking in with your peeps is an important way to make sure you know who they are and what they want.
This is especially important when it comes to a) transition points in the growth of your community, or b) product development at any time. Surveys allow you to take the pulse of a large group of people in a short period of time– and because of how sampling works, you don’t actually need to hear from all of them to know what most of them are thinking.
Keep in mind that most readers or customers are usually in the Silent Majority. As I’ve said before, well over 95% of them (sometimes 99%+) do not usually feel the need to participate in public responses like website comments or even one-on-one correspondence through email exchanges. If you want to know what the Silent Majority thinks, a survey is a great way to bring people out of the woodworks.
Granted, surveys also attract a self-selecting group of respondents, so there is still a big “Really Silent” Majority out there, but short of stalking people on an individual basis, a survey is the best you can get. The rest of this article will explain exactly how to set up an online survey– it’s actually quite easy– along with a few points on data interpretation that I’ve learned through trial and error.
Logistics and Design
The logistics to setting up a survey are very simple. To manage the data and make it easy for the respondents, you need to either use an online service of some kind, or hack it out yourself.
I’ve used Survey Monkey for years and am happy to recommend them without any benefit for me. It costs $19.95 a month for the premium version (the free version is OK for testing but then gets pretty limited) and is worth the investment if you’re in it for the long-term. There are some free alternatives, but personally I am happy to pay $19.95 a month for a service I know well. Some of the free options have intrusive ads on their survey forms, or redirect users to the survey service homepage at the end. Even though it may be a small thing, I never want to abuse the trust of someone who wants to share their input with me. Therefore I use Survey Monkey.
If you want to do it on the cheap, you could also hack together a survey using Google Forms. I’m not the best hacker and I already know another system, so I personally don’t have any need to change anything.
After you decide on how to collect the results, you need to set up the actual survey. Here’s where you need to think very carefully about what you really need to know from the respondents. You don’t want to waste anyone’s time by asking for irrelevant information, but you also don’t want to miss anything important.
Whatever you decide, I recommend including variations of the following two questions:
1) In 1-2 sentences, why do you read the Art of Non-Conformity site?
2) What do you think is the #1 thing I can help people with?
Obviously, you adjust these questions based on whatever it is you do. Also, if you have a few ideas of upcoming projects in mind, it’s good to test them out in the form of a ranking system. I usually phrase the question like this:
Here are a few things I’m thinking about doing in the next few months, but I could be totally wrong! Please let me know what you think of each idea.
Idea #1
Idea #2
Idea #3
etc.
I then apply a simple ranking scale to each idea and ask respondents to side with their first impression. The ranking scale I use usually consists of answers like “I love it! You should do it; Sounds Interesting; Would Need to Hear More; and It’s Not for Me.”
Generally speaking, I like to keep surveys brief – less than 10 questions or so overall. To get more responses, ask less questions. To get more detailed responses, ask more questions. It’s up to you, but just make sure that whatever you ask is something you actually need to know about.
Once your survey is ready to go in Survey Monkey or whatever platform you use, you’ll get a link to share with your readers, customers, or community. Be sure you test it in a couple different browsers to make sure it’s working, then send it out to your group with a polite request asking for input.
Limiting the Responses
I limited the first AONC survey last year to 250 responses and turned it off after two days. I tried to limit the most recent one to 500 responses, but had to turn it off after just a couple of hours – even on Labor Day, when a lot of people in North America were away from their email. After setting up the survey, I was a bit late getting back to my computer and ended up receiving more than 750 responses. (You guys are so fast! Sorry to everyone who got there afterwards.)
I deliberately limit the responses because a) much of the feedback will overlap after a while, and b) I want to pay close attention to what each person says. With more than a few hundred responses, I simply won’t be able to do that. My philosophy is that if someone takes the time to think about the questions and give me their detailed feedback, I don’t want to just skim their comments; I want to pay close attention to each of them.
Also, I don’t mention this in advance, but I try to send a short thank-you note to each person who takes the survey, and I couldn’t easily do that with thousands of responses. I know that this kind of task is inefficient and difficult to scale, but I also know that each person took a few minutes to share their input, so why can’t I take a few hours to write everyone to tell them I appreciate it?
Interpreting the Data
Once you get a good range of responses (I like 100+, although if you have a smaller group you can still get valid feedback), you want to review the data and find out what people have to say. Here are a few important notes on that process.
You’ll likely learn things you never knew before. One of the most interesting and insightful outcomes from a good survey is when you find yourself surprised by some of the responses. For me, one of the most important things I have consistently heard is that people read AONC because it helps them to not feel alone. Over and over I hear variations on this theme. I never could have expected this kind of feedback in the beginning of the project, but it’s now one of the things I’ve come to identify with most closely. As long as I’m connecting on that level with some people, I know I’m on the right track– and when you do your own survey, you may find something of your own that you never expected on your own.
Some feedback will be contradictory. If I ask about products, I usually gauge the initial interest level by listing a few things I’m thinking about building over the next few months. Inevitably someone will think a particular idea is the greatest idea I’ve ever had while someone else will think it’s terrible. The truth is probably somewhere in between, or they could both be right in their own way– for one person, it’s a great idea, and for another, it’s terrible.
Often this kind of feedback arrives back-to-back, which is interesting to compare. Again, it doesn’t mean they are wrong, or that I’m wrong. It just means that different ideas will resonate with different people.
When you take a survey, look for the trends. What jumps out from several hundred responses? What are people most interested or excited about? The trends are the obvious observations that come from looking at the data in spreadsheet form, and can usually give you an idea of what to do next.
To take it further, though, you’ll want to avoid looking strictly at the majority/minority data points. What I mean by this is that many projects are best suited to a passionate-but-small base of users. For example, when I asked about topics for future Unconventional Guides, the one on Frequent Flyer Miles was rated in the middle instead of near the top. Despite the average ranking, I know that people interested in earning miles and redeeming them for free travel are quite a passionate group. If I can reach that group, I won’t hesitate to proceed with the project even though I also know it won’t be a good fit for everyone.
Asking for name + email address is good. The first time I took a survey, I didn’t ask for any personal information on the grounds that more people would be willing to respond. I then found that the problem with complete anonymity is that if you want to follow-up with someone after reading their comments, you have no way of doing so. Asking for some basic information also ensures that you’re getting respondents who care enough about what you’re doing that they don’t hesitate to share their contact details. Of course, none of the information is shared or used for any other purpose.
In the end, you have to do what you think is right. Obviously, I’m a big fan of surveys, but in the end, the group opinion isn’t everything. I don’t think your course should be set for you by other people, even if the other people are like-minded or agree with you. Among other things, you have to have your own motivation for doing whatever it is you want to do. If your motivations are based strictly on the preferences of someone else, you’ll run the risks of burnout, boredom, unhappiness, or simply being less than you could be otherwise.
What I mean by this is that you can’t simply ask and let people tell you what you should be doing in your project. Feedback is great, but in the end you are the one responsible for the outcome. Also, sometimes what people want and what they say they want are two different things– but that’s a topic for a whole different article!
Wrap-Up
I’ve always liked this quote from the mad hatter in Alice in Wonderland: “If you don’t know where you’re going, any road will take you there.”
Granted, a survey won’t necessarily help you know where to go if you don’t have at least a general idea in the beginning. The individualist in me would assert that you can chart your course without feedback from anyone and you’d be totally fine. The community-builder in me, however, knows that your work will have a deeper impact if you take the pulse of the group from time to time.
I hope this is helpful to those of you who are also trying to build something bigger than yourself. Wherever you’re going, stay the course!
***
Also Read:
Business, Blogging, and Broken Windows
Product Launch 101
Unconventional Business Ideas
What Makes a Community?
###
Did you enjoy this article? Please pass it on to others at StumbleUpon, or share your own thoughts in the comments section.
Survey Image by Kim Pierro
Sorry if it was a bit long.
comments