黑料社入口 Attribution Models: How Did We Get Here? A History of Measurement
Our first installment of in our series on attribution, The Light at the End of the Tunnel, we shared a summary of the shortfalls, or opportunities we encountered in our discussions with marketers and other industry experts, in search of better measurements to uncover inefficiencies and find hidden opportunities in their marketing efforts.
In this installment of our Attribution Buyers Guide series we will try to define the many different categories of marketing attribution: 黑料社入口 Mix Models, Lift Studies, Multi-Touch Attribution models, and the newly minted 鈥淯nified Measurement鈥 (Forrester鈥檚 descriptor) or 鈥淭otal 黑料社入口 Measurement鈥 (Gartner鈥檚 descriptor). Let鈥檚 start our journey.
Where 黑料社入口 Attribution All Started: 黑料社入口 Mix Models
To go back to basics, we have to answer the questions of what is marketing mix modeling (MMM)? 黑料社入口 mix modeling can be defined as a strategy to understand how each component of marketing is contributing to sales. By applying regression analysis to historical sales data, marketers used MMMs to analyze the effects of changing different marketing activities.
黑料社入口 Mix Models (MMMs) can trace their roots to the 1950s and became popular in the 1980s. This approach has its merits, including the potential use of at least partially controlled experiments, and its cross-channel coverage of all media types. These are important aspects of an attribution model! MMM鈥檚 biggest strength, however, has been a lack of alternatives. Many marketers still use MMMs for top-level media planning and budgeting, mostly because they haven鈥檛 caught up with some of the recent innovations that expand and build on what鈥檚 great about these older attribution solutions.
As useful of a tool as MMMs have been however, they have numerous shortfalls including:
Too Slow
Results are usually only available weeks after rather than during the campaign.
Overly Behaviorally-Centered
Brand equity is poorly measured by MMMs, if at all. This leads to overspending on lower funnel activity and under-spending in developing the brand among people who need more education and motivation to act. Because of this, MMMs are not a good tool if your company needs to launch a brand campaign.
Absence of the Critical Role of Message and Targeting
The media is a container holding a message, delivered to a specific audience. Change the message, or change the people the message goes to, and the media impact changes dramatically 鈥 but mix models miss this critical element of how advertising works. MMMs fail to optimize message and targeting first, before recommending the optimal media mix.
Lack of Detail
MMMs bucket impressions into groups such as Facebook or Prime Time TV, thereby losing significant optimization opportunity. This lack of detail is particularly problematic for media with small reach. Since they measure at an overall aggregated level, a marketing activity that only reaches a small percentage of people may have an impact which is not statistically significant once averaged with all the people not reached. This problem was particularly pronounced for digital media measurement, and led to two separate solutions to the short-comings.
The Half-Step Forward: Digital Attribution Models
Emergence of Multi-Touch Attribution (鈥淢TAs鈥)
With MMMs failing to help digital marketers, 鈥渓ast click鈥 and 鈥渓ast-touch鈥 emerged. They assigned full credit to the final ad click or exposure, respectively, prior to a consumer鈥檚 purchase action. These activities could be measured by an advertiser鈥檚 third-party ad server in places where the ad server鈥檚 pixels could be fired. Limitations were numerous. 鈥淟ast-touch鈥 method fails to capture the value of many other factors that may have contributed to the desired behavior, or understand if that behavior might have happened in the absence of the advertisement 鈥渢ouch.鈥
It may come as a surprise to many that 12% of marketers self-reported as using a last-touch model in 2016. You know who you are, but don鈥檛 worry, help is on the way!
Product innovations later in the decade enabled marketers to apply custom weightings, or 鈥渇ractional attribution,鈥 to recognize the value that different touchpoints may have had in shaping a user鈥檚 decisions.
Ad servers began to develop support for this fractional attribution, and a new category of services designed specifically for ad effectiveness measurement, or attribution, emerged as well. Path-to-purchase became popular, allowing marketers to see the steps leading up to a purchase at an individual person-level. However, this correlation analysis has created flaws, which we鈥檒l address in the next article in the series, which promotes the importance of person-centric marketing.
Attribution Models filled gaps left by MMMs, including the ability to measure in much greater detail, at a person-level. This enabled much more granular analysis of what鈥檚 working鈥攅.g. targeting strategies, creative, time of day, etc.
While Multi-Touch Attribution (MTA) significantly improves digital measurement compared to mix modeling, Gartner points out that many marketers have become disillusioned with MTA. Their shortcomings include a poor job at measuring external factors, poor offline media measurement, a lack of connection between brand and sales performance, methodological flaws that compromise conclusions, slow backward-looking results, 鈥渓ocation鈥 gaps, and complicated set-up susceptible to cookie deletion. In the single month of May 2014, three of the MTA vendors were acquired. The acquisitions, it can be argued, slowed innovation for the purchased companies. However, it did not stop innovation for the measurement industry.
Lift Studies
If the shortcomings described so far weren鈥檛 enough, 鈥淎ttribution鈥 became a hyped term. What used to be called a 鈥淟ift Study鈥 by ad sellers began to be called 鈥淎ttribution.鈥 These lift studies, which measure the impact of a single media channel in isolation, added to the perception that attribution measurement is incomplete. As the name implies, lift studies apply experimental design to show incremental value (lift over control), which we applaud. However, it鈥檚 their single-channel focus that leaves much to be desired.
Lurching Towards the Future: Person-Level Cross-Channel Optimization
In the same way that digital attribution solutions emerged in response to the shortcomings of mix models, person-level cross channel optimization also emerged to address the shortcomings in measuring digital. At the time, digital lift studies using design of experiments had established the incremental value of online advertising. Marketers wanted to know if they should re-allocate budget from TV and other traditional media to digital. MMMs couldn鈥檛 answer the question.
The (IAB), The (ARF), The (ANA), and the (4As) joined together in support of a new methodology for measuring online and offline advertising.
The approach used person-level data to link online advertising to offline sales, to measure branding as well as sales behavior, to measure message impact, path to purchase, and message impact (combined with design of experiments). The method initially controlled for external factors, and eventually applied external factors to the person-level dataset.
Admap wrote up the breakthrough methodology in its October 2005 edition. Leading academics such as University ofChicago Economist and Best-Selling Author of 鈥淔reakonomics鈥 Steven Levitt described the method as having 鈥渢he power to cut through the Gordian knot of advertising and marketing complexity.鈥 It took off from there:
- BusinessWeek included results of the method on the cover, in an article entitled 鈥.鈥
- The Journal of Interactive 黑料社入口 published 鈥溾 that showed the method used to measure online and offline media down to the person-level, connecting branding and sales.
- ESOMAR (European Society for Opinion and 黑料社入口 Research) named the method one of 30 best practices in all of research in their (Wiley).
The method was applied globally in dozens of countries.The main shortcomings of the methodology were the complex setup and cost. As the method pre-dated cloud computing, the analysis was data-intensive and computationally costly. It was valuable to the top 50 marketers spending heavily, but at the time, not practical as an 鈥渁lways on鈥 measurement system. Most marketers used the method at a specific point in time to answer looming strategic questions such as the appropriate investment level in digital marketing, social, etc. Arguably, it was a method a decade ahead of its time. Recently, the method has re-emerged in what Gartner calls 鈥淭otal 黑料社入口 Measurement鈥 and Forrester classifies as 鈥淯nified Measurement.鈥
Advances in cloud computing, person-level identity systems, and data availability have made it possible to advance the state of measurement. While there are many more advances to be made, it has never been a better time for data-driven marketers to get the tools they need to be successful.
The Future is Now: Unified Measurement / Total 黑料社入口 Measurement
Forrester Research coined the term 鈥淯nified Measurement鈥 in their October 2016 Wave Report. Gartner introduced the term 鈥淭otal 黑料社入口 Measurement鈥 at their 2017 Digital 黑料社入口 Conference. While there are nuances, the concept in common is the evolution of methods to provide one integrated view of marketing effectiveness. Gartner incorporates a consistent view of the consumer, implying person-level analysis. Forrester encourages a unified view that incorporates the person-level granularity introduced by the MTAs and applies it across all media channels in a way that MTAs historically have not, therefore retaining some of the key virtues of MMM.
Some Unified 黑料社入口 Measurement models include 鈥渆xperimental design.鈥 This simultaneously eliminates the 鈥渂lack box鈥 stigma of most MTAs, while eliminating erroneous allocation of credit resulting from correlation-based measurement.
Unified Measurement models also enable marketers to understand the impact of creative in a more granular fashion than previously possible, therefore allowing marketers to understand this important part of the equation. Perhaps most significant is that the Unified Measurement approach introduces new capabilities that become available when marrying the benefits of MMMs and MTAs, thereby creating a 1+1 = 3 effect.
In addition to recommending the Unified Measurement category, Forrester further encourages marketers to evaluate vendors within the category in detail. For example, some vendors specialize in understanding connections between branding and performance; others may integrate both marketing mix modeling and external factors, such as the weather and economy, with the person-level measurement capabilities introduced by MTAs; yet others may differentiate based on their cross-device user graphing. We begin to identify these important attributes in our next article on how to measure marketing on the person-level.
Final Thoughts on Unified Measurement
黑料社入口 attribution models have come a long way since they first emerged in the 1950s with the unified measurement model offering a person-centric approach and real time data. To learn more about how 黑料社入口 can help your company with digital optimization and marketing intelligence as well as how to get the most of your online and offline marketing efforts, contact us today.