Kieran Michael’s Random Thoughts on Technology & Marketing

This Space Left Intentionally Blank

Open Source Market Research

with 3 comments

Time for another installment of (perhaps) interesting ideas that are (probably) not ready for prime time….

Open Source Market Research

An oxymoron, non? Actually, people have tried to monetize this concept, but I’m not talking about reselling old, sometimes public domain, market research reports or traditional syndicated research. Moreover, when I think of open source, monetization is not top of mind. In fact, I’m not even thinking of giving people access to actual market research reports. What I am considering is this: is it possible to construct a type of searchable database containing non-proprietary outputs (and ideally meta-outputs; more on that at the end) from actual industry quantitative and qualitative research?

Let’s say, for example, that your company has a new product, Liquid X. Your industrial design people (or more likely some ambitious brand manager) wants to put Liquid X into an “upside down” container that stands on its cap. You’ve seen this done many times with toothpaste, ketchup, shampoo, etc, but your company has never done it. What are the basic parameters and constraints that affect usability? How best to handle copy? Should the new upside down packaging cannibalize the existing line?

Now imagine that you are in charge of doing the market research for Liquid X, except that you can log onto a site that will let you search for pieces of market research that someone else has already conducted on upside down packaging. You might be able to see right away that height is a limiting factor, for example, or that there is a particular consumer segment who just won’t buy anything upside down-ish. You would not be looking at full market reports – only discrete bits of them that you can use to jump start your research, to narrow the parameters of what you do need to research and save you time and possibly money. Naturally, you might be able to find some of this information through traditional syndicated research, but that process is itself often difficult and time consuming. I’m imagining a Google-like, or perhaps Del.icio.us-like front end serving up extensible results.

There are, of course, a couple of big problems with the idea of Open Source Market Research: how would it actually work and how could you participate without giving away your competitive or trade secrets?

The first problem is actually the most difficult. Thinking about open source and this system, something wikipedia-esque is top of mind. But obviously, that would require far, far too much work on the part of those who could contribute; they would have to scrub or anonymize their own data and possibly edit the format itself (e.g., extract bullets from PowerPoint slides). Perhaps a better idea would be some kind of industry or foundation operated site (perhaps supported in part by ad revenue) to whom you could submit reports. This organization would scrub and anonymize the data, index and tag it, and provide the search engine front end. In this scenario, you might have to find a way to incentivize companies to part with their dearly bought research, perhaps by offering ads or referrals. Naturally, the hope is the inherent benefits of open source will be enough to sway doubtful IP holders.

The other – surprisingly simple – problem is competition. Simple, but with one big caveat: whomever is anonymizing and scrubbing must be trusted beyond reproach and some research might be too topical or too sensitive to share for a period of time, no matter how well anonymized and scrubbed. Competition, in general, wouldn’t be an issue with such a system, as the results are analogous to lego building bricks rather than to someone’s fully built model. Moreover, as everyone has access to the same building bricks, competitive advantage lies in how you assemble them, not in “possessing” the bricks. This is, essentially, the ethos of the open source movement

Less abstractly, except in the case of highly proprietary processes or data, you can argue that increasing overall awareness of different types and outputs of market research will increase demand for market research. In fact, some companies, like Aurora WDC are betting on it. A system like the one I am proposing would effectively grow the pot for everyone involved in MR. Even in the sometimes esoteric and often secretive world of competitive intelligence (where I often work), people like August Jackson are leading the discussion about the value of, essentially, open sourcing currently proprietary conference talks and materials. Although this link is an extreme example, Bruce Schneier makes a compelling case that openness inherently solves many more problems than it creates.

Finally, one far-off but potentially interesting benefit from open source market research would be in allowing average Joe or Jane market researchers to construct their own MR meta studies a la the healthcare industry to gauge the effectiveness of their own MR initiatives and processes.

Written by KM

August 22, 2008 at 3:33 pm

3 Responses

Subscribe to comments with RSS.

  1. Kieran Michael,

    Great post and a neat idea. Thanks for the link too :-)

    I’m a big advocate of the removing of artificial scarcities and bottlenecks in the flow of information through public forums. Data and facts in that sense are a lot like the latest scores from the sports page in that it will inevitably become free (as in software, not free as in beer) and mashable with other data as you suggest to form a higher order of information – in this case, “findings” based on analysis of that data.

    Ultimately however, as you also suggest, the real value is highly contextual to the user and their use case and related to an even higher order of information in terms of recommended action based on those contextual findings. In that sense, what is valued by one user is of a different value to virtually everyone else. Indeed, pattern analysis of the data itself would have the broadest value in terms of describing what reality looks like, albeit, always imperfect as it would be always incomplete.

    Keep up the great posting!

    - Arik

    Arik Johnson

    August 25, 2008 at 2:29 pm

  2. Can I re-write the post appropriating the clarity with which you distilled the benefits of my proposed system :)

    And you make an excellent point that such a system would not disintermediate MR firms; on the contrary, the more data you have, the more critical human analysis and recommendations become.

    KM

    August 25, 2008 at 3:30 pm

  3. Keiran Michael,

    I enjoyed this post and Arik’s comments as well.

    My sense is that looking for readily available market research is often the first step to determine if it’s worthwhile to spend more money or time. I’m presently working on one in a long succession of projects where this is the case.

    I agree with both you and Erik but the bottleneck I’d most like to free up right now has to do with finding experts in emerging markets. At the end of a long day of open-source meta research what I would like to see most is an online idea exchange market place where I could meet up discretely (at least initially) with others pursuing the same research problem; is there really a market and is it big enough to warrant further investment.

    Suzanne Klein

    December 6, 2008 at 3:29 am


Leave a Reply