Startups Choose Doing Surveys Over Customer Interviews At Their Own Peril

Alternative title:  Surveys make entrepreneurs lazy.


Entrepreneurs tend to be skeptical about the notion of doing qualitative research as means to validate their business hypotheses and establish if there’s a real business opportunity.  This attitude comes from the notion that, in order for information to be reliable, it needs to come in the form of tables and charts derived from quantitative research.  “In ‘hard data’ we trust!” seems to be the mantra.  This is particularly true for those working in the consumer space as tabulated data provides a condensed view of thousands of people at once, which is understandably, music to their ears.  And what’s the best way to obtain the numbers that feed into those lovely pie charts?  You guessed it: surveys.


The allure of surveys

Surveys make an appealing case: they allow us to gather data from thousands of people with relatively little effort.   In the case of online surveys the temptation is irresistible as with just a few clicks we can setup a questionnaire, distribute it, tabulate the incoming data and visualize the results.  What’s not to like?!  Well, surveys are not the right tool for the type of job that needs to be done at early stage startups.


We don’t know what we don’t know

As obvious as it may sound this riddle-esque idea has an implication so subtle it escapes many: we can only inquire directly about known unknowns.


Think about it this way: we can only ask questions about the things we know we don´t know.  When it comes to survey questionnaires, the range of themes addressed in those yes/no and multiple-choice questions (and their answer choices) are limited by our current knowledge of what the range of possible themes is.  We are, by definition, leaving out key questions that could potentially unearth breakthrough insights simply because we are not aware of them (as if they were out of sight).

But wait! That’s why we have open-ended questions in surveys, so people can speak their minds, no?

In theory: yes.  In practice: rarely.

Who hasn’t designed a survey questionnaire that included questions like “Why?” to cast a wide net and added “Other.  Please Explain.” at the end of a set of answer choices (of a multiple-choice question) to cover their back?  But after going through the rather bland and generic responses from those few kind people who after rolling their eyes made the effort of providing an answer, it becomes rather obvious that we were being naïve.  By asking these tell-me-everything-I-don’t-know-about-you questions we assume that people are willing (or capable) of analyzing themselves on a given situation, and then articulate conclusion in a tidy sentence.  And all this on a split second.  There’s no way than will happen!  It’s worth saying that using open-ended questions in survey questionnaires is not the issue, but rather how we use them.   Open-ended questions yield better results when they focus on having people describing past events (e.g. “What happened that time when…?”) or behavior (“How do you…?”).  But even the responses from questions such as these should be treated with a pinch of salt, especially those inquiring about people’s problems (but that’s the subject of another post).


Bumping into unknown unknowns

This is precisely where surveys fail and qualitative research has the upper hand.  Bumping into unknown unknowns is what early stage startups should learn to do in a systematic manner.  And there’s no better way to break free from the cage that represents our current knowledge of things (i.e. both known-knowns and known-unknowns) than by talking to people in the form of customer development interviews.  It’s through (structured) conversations that we give ourselves the chance to be surprised (and many times inspired) by something someone says.  It’s the ‘randomness’ of people’s stories that allows those I-would-have-never-thought-of-that-in-a-million-years! moments to happen, opening in front of our eyes a window of possibility which we didn’t know was there.


The right time for doing surveys

Simply put, surveys are most effective when we want to define the relative importance of things and to establish priorities.  This means that we make the most of surveys only when we know (based on the learning from customer development interviews) which are the right questions to ask, and ideally, what are the most likely answers.  For example, through surveys we can refine the demographic and psychographic profile of our target segments (from interviews we learned there was more than one), identify how widespread is a behavior (which unexpectedly emerged in the stories of a few people) and establish who are the main competitors (including those makeshift solutions people showed us).


The many excuses for not doing interviews

At the top of the list there is laziness.  Plain and simple.  It’s undeniable that preparing and conducting customer development interviews require much more legwork than running online surveys from a laptop, and sadly, this is one of the main reasons why entrepreneurs  (even if they fail to admit it) prefer to look the other way.  Others who consider themselves domain experts (usually due to their previous work experience) say that talking to people is something they’ve already done in the past or they believe there’s nothing new they could learn thus they would rather spend the time doing something else.  A few others are simply unaware of how they could ‘do research’ besides the techniques they see being used by big established companies.  But the truth is that no matter the excuse, failing to spend time face to face with prospects represents a risk very few startups can afford i.e. missing out on bumping into the nugget of information that  will change their fate.

Startups Choose Doing Surveys Over Customer Interviews At Their Own Peril

12 Responses

  1. Basically, you can only do 5 invoices, 5 proposals, and 5 expenses in the free version. 6) Easy export and import:- A tax
    preparer can easily import W-2, Schedule D, Trial balance and Year-end
    balance, as well as forms like child’s form 8615 and K-1 data from 1041, 1120S, and 1065
    are easily exportable. For conducting the additional analysis on the specific CPA
    network, which will assist you to earn funds,
    all you want to do is you will need to place in the identify of that network along with some
    other applicable keyword phrases that could possibly
    assist you in discovering out if there is any precise challenge with that
    individual organization.

    Boca Raton Discount CPA Supplies September 13, 2014 at 10:36 am #
  2. The answer is YES, if the h – CG (human chorionic gonadotropin) is obtained without a valid prescription from a physician (MD or DO).
    Although you’ll find many versions from the diet regime employed with HCG drops,
    numerous of them are severely calorie restricted and need to have you to
    location four drops of your HCG mixture underneath the tongue twice a day.
    The structure of the day, whether at work or at school with a planned breakfast, lunch time and a snack food help men and women control their eating.

    Hcg Weight Loss For Metabolic Syndrome September 21, 2014 at 9:07 am #
  3. It’s also a great idea to add a link to your blog in your email signature, newsletter and even your business card.
    There you have obtained it 4 aboveboard to attach to consideration in affiliation to in might maybe need of
    Herve Leger V guitar neck Bandage Dress Black. Cobras and Mambas inject Neurotoxic venom which will affect the nervous
    system and cause initial muscle weakness, blurred vision, difficulty in swallowing and breathing
    and eventually paralysis.

    bandage dress store in los angeles September 23, 2014 at 9:28 am #
  4. I read a lot of interesting articles here. Probably you spend a lot of time writing, i know how to save you a lot of time, there is
    an online tool that creates high quality, google friendly articles in minutes, just type
    in google – laranitas free content source

    Dorine September 23, 2014 at 11:08 am #
  5. A diploma from fashion designing colleges is obviously your first class
    ticket to a career in fashion design. Herve Leger
    gown may be the dream of countless women of all ages needless to say as well as me, although not almost everyone can manage it even when you need
    to personal. If you have eyeglasses that could do these
    items, it’s surely no surprise they’re liked by VIPs.

    bodycon dress making pattern September 27, 2014 at 1:13 am #
  6. Generally I do not read article on blogs, however I wish to say that this write-up very pressured
    me to take a look at and do it! Your writing taste has been surprised
    me. Thanks, quite nice post.

    Violet September 29, 2014 at 12:27 am #
  7. It’s essential to have a clean skin before applying a
    tanner. You can buy swimsuits in floral and island prints to add more fun to your look at the beach.

    Why bother to spend tens of thousands of dollars, after all,
    on something you may only need to use for a limited time.

    tan October 3, 2014 at 3:11 pm #
  8. Link exchange is nothing else except it is simply placing the other person’s
    web site link on your page at appropriate place and other person will also do similar
    for you.

    Line Disney Tsum Tsum Hack October 5, 2014 at 9:52 am #
  9. If you are going for best contents like me, only go to see this
    website everyday as it provides feature contents, thanks October 8, 2014 at 9:29 pm #
  10. Thank you for the auspicious writeup. It in reality was once a entertainment account it.
    Look advanced to more brought agreeable from you!
    By the way, how could we keep in touch?

    translate online October 16, 2014 at 8:40 am #
  11. Very rapidly this web site will be famous amiid all blogging people,
    due to it’s good articles

    Homepage October 18, 2014 at 2:36 am #
  12. Thanks a bunch for sharing this with all people you really recognize what you are speaking approximately!

    Bookmarked. Kindly also seek advice from my
    website =). We will have a link alternate agreement
    between us

    site De rencontre coquin October 20, 2014 at 7:56 am #

Leave a Reply