Measuring ROI Still Misunderstood – That’s the Work of Analysis, not Metrics

Measuring ROI Still Misunderstood – That’s the Work of Analysis, not Metrics

Proper use of metrics is still misunderstood. Marketers need analysis not metrics to assess marketing ROI (return on investment).

Analysis is Metrics+Context+Conclusions+Recommendations.

More education is needed to explain the difference between metrics and analysis. So many opportunities are lost while people sit back waiting for metrics to speak.

eMarketer’s article Marketers Need Metrics to Integrate Traditional and Digital Media” demonstrates this gap in marketers’ understanding very clearly. Take this sentence about what marketers need:

“Several obstacles prevent further adoption of digital media. The largest hurdle to overcome, according to the ANA study, is the need for metrics to properly allocate the mix between traditional and digital media.”

Marketers surveyed appear to expect “metrics” (i.e. data from tools) to properly allocate the mix between traditional and digital media!

Given this expectation, they will forever be disappointed.

No tool will ever do this satisfactorily 100% of the time on a fully automated basis.
[Have you ever had strange reading recommendations from Amazon?]

People … thinking people, analytical people … will have to analyze metrics, segment and analyze further, reconcile discrepanies, resolve confusion.
People will come to conclusions and recommend mix allocation.
People will implement.
People will assess the outcome.

And because in the real world, implementation never goes exactly as planned, the data will be dirty, the metrics will be confusing and People will have to clean it up and make sense of it all.

An obstacle in the increasing use of digital media is “a lack of understanding of digital media on the part of senior management”. Given the expectation that metrics should tell the story, this is probably because metrics are presented raw, without analysis not integrated with a marketing story. Senior management sees ‘data’ when what they want is ‘insight’ and a cohesive story about why investing in digital media makes sense and makes money.

eMarketer closes with this comment:

“Unfortunately, the necessary data is currently scattered across organizations. Data formats are inconsistent and so is terminology. Until these problems are solved, marketers attempting to integrate traditional and digital advertising channels will continue flying blind. “

Absolutely true that data is scattered, formats are inconsistent and so is terminology (see previous post on “unique visitors’). But this is no excuse for throwing up one’s hands in dismay and accept “flying blind”.

Those who wait until the “perfect tool” does their analysis for them will wait forever.

Those who do not wait and dive in and handle the problem will drive their competition out of business.

Do you want to be a winner?

Then don’t sit back expecting your metrics to speak to you.
Get to work analyzing your metrics.

Love to hear your thoughts.

You are not alone. Looking for a great place to discuss these issues? Try eMetrics, a local Web Analytics Wednesday, or online at WAA webinars, and various measurement and analytics forums (see suggested list).

June Li
ClickInsight
====

By |2019-05-17T11:57:19-04:00April 29th, 2009|9 Comments

9 Comments

  1. Emma May 4, 2009 at 8:53 am - Reply

    I couldn’t agree more.

    Analysis is a lost art – people focus on the metrics, reporting and dashboards but forget that without analysis there is no insight. It is the interpretation, and the ability to keep questioning, that provides learning (not reams of numbers).

    • Kevin September 9, 2012 at 6:27 am - Reply

      Review by J. Whitehead for Rating: I’ve already put into aiotcn some of the advanced tips in this book even though I haven’t quite finished reading it yet which makes it an excellent investment. It covers strategy, implementation and real world usage in clear terms that are easy to follow. It should answer any question you have of Google Analytics, and in my opinion is more palatable than Google’s own help section.The real world examples are excellent, real situations that users will face explained in a manner that takes account of the business need, the roles effected and detailed implementation, report and analysis guides that work like a charm.This will be one I use again and again

  2. June Li May 4, 2009 at 5:49 pm - Reply

    Lost art is a good way of putting it. Perceived as old, known and therefore not relevant.

    So, how do we help others ‘get it’?

    Perhaps ‘marketing analytics’ needs include more of the marketing of analytics. Maybe a future discussion topic at the CMA Tech Council or Data Mining Forum?

    Thanks for commenting!

    • Ryuta September 9, 2012 at 2:09 pm - Reply

      Review by Chris W for Rating: If you’re new to Google Analtyics get this book. If you’ve been using Google Analytics for some time, get this book.I bought this book a few mnoths ago and it hasn’t left my desk. It contains everything you need to know on Google Analytics from start to finish and explains everything in an easy to understand, step by step manner. The fact that it also gives you the example code every step of the way makes things so much easier to implement on your own site. It’s helped sort out so many of the tracking issues on our site.I’d definitely recommend this book.

  3. Dag May 7, 2009 at 8:50 am - Reply

    June,

    Good comments about the metrics vs analysis. I think that you are correct from a linguistic perspective, however in real life, I think most people use both words to mean the same within the context. I think the fight should not be over which word to use, but instead — and I think this is the most important point — where one should look for real information. And I agree with your (using your wording) that analyst should pour over the metrics, then make their analysis, which is then presented (as marketing analytics) to the decision makers who will make the decisions.

    As a side note, which you might be interested in as you are discussion ROI. I pulled together an Social Media ROI calculator in spread sheet format. It is located at dagholmboe.wordpress.com. Check it out, as it helps a marketing company assign cost and values for benefit analysis. It is based on work by Charlene Li (Forrester) and Bill Johnston (Forum One).

    Again, great post. Keep them coming.

    Dag.

  4. June Li July 1, 2009 at 12:39 am - Reply

    Dag,
    I agree that words are just words and the context is important. Unfortunately, more often than not, the context is not specified.

    Appreciate your mention of the Social Media ROI calculator on your blog. It is good that you have given context to the metrics you’ve included in the spreadsheet. Even if folks have trouble completing the spreadsheet, it is a very useful catalyst for discussion and thinking about the whole problem of measurement. Will be mentioning your posts on social media analytics and your calculator in a future post.

    Thanks for reading, and sharing your thoughts.

    ~June

    [Original comment from early May deleted, likely due to my user error. Don’t have the exact words but gist is same.]

  5. Dag July 1, 2009 at 2:42 pm - Reply

    June, thanks for your comment and also thanks for taking the time to read my blog entry. I am due for another post but… sigh.

    I looked at your profile on LinkedIn. It is very impressive.

    Dag.

  6. June Li July 2, 2009 at 5:58 pm - Reply

    Dag, thanks for the compliment 🙂

    • Iwish September 9, 2012 at 12:33 am - Reply

      Review by Daniel Waisberg for Rating: Advanced Web Metrics is an outstanding book. It croevs from shallow to Deep Ocean and gives the necessary tools to navigate through waves, tempests and calm seas. And it shows the reader how to find islands of insights!Brian Clifton describes techniques that will help you understand and improve your website using Google Analytics. He goes over very important concepts and questions that are usually misunderstood: Why Web Analytics is important what are the available technologies? How Google Analytics works how it deals with privacy? Which reports should you use how to do it? How to ensure that your data is accurate how to enhance your reports using advanced implementation techniques? The book is not a theoretical read; it goes into real world tasks and shows the reader what he needs to know in order to succeed using Google Analytics. In addition to showing all there is to be shown on Google Analytics, he also provides some very useful examples on third party applications that use the Google Analytics API and out of the box integrations with other tools or sources of data (CRM, call tracking, Website Optimizer).But the biggest quality of this book is the way Dr. Clifton approaches the subject. Even readers acquainted with Google Analytics and optimization techniques described in the book will find insights that will help them understand the subject deeper and organize the knowledge in their brains.

Leave A Comment