The 2026 Measurement Crisis: Why Your Media Efficiency is Probably a Lie - Episode 438

🎙️Interview With Sally Kazin and Ross Walker

DESCRIPTION

Welcome to The Ecommerce Braintrust podcast, brought to you by Julie Spear, Head of Retail Marketplace Services, and Jordan Ripley, Director of Retail Account Management.

Today, we are getting into something every brand needs to hear - because what you think you know about your media performance might be complete fiction. 

We're talking about the 2026 measurement crisis. The moment when the gap between what your dashboards say and what your account shows has become impossible to ignore. 

And to help us make sense of it all, we have two incredible guests from the Acadia team with us: Sally Kazin, Head of Analytics, and Ross Walker, Director of Retail Media.

Let’s dive in! 

“The gap between the dashboard numbers and the ground truth has become impossible to ignore.”
— Sally Kazin

KEY TAKEAWAYS

In this episode, Julie, Jordan, Sally, and Ross discuss:

  • The growing "measurement crisis" in ecommerce, where platform-reported revenue often exceeds actual sales due to duplicated attribution claims across channels

  • Transition from reliable observation-based tracking to a world of estimation and modeling, driven by privacy changes and a fragmented platform landscape

  • The challenges posed by siloed data, platform biases, and engine inflation in retail media and traditional paid channels

  • Widespread overreliance on ROAS as a North Star metric and the pitfalls of "ROAS jail" for both brands and CFOs

  • The limitations and decline of Multi-Touch Attribution (MTA), and why Acadia now deploys a three-pillar measurement framework

  • The importance of glass box (transparent) models over black box or "off the shelf" solutions, balancing science and business art in measurement

  • Pairing MMM with real-world incrementality tests for a self-correcting measurement loop

  • How to communicate with CFOs and senior leadership about marketing impact, translating platform metrics into true business outcomes and incremental revenue

  • The evolution of MMM: from slow, backward-looking models to AI-enabled, forward-looking, and more frequent scenario planning

  • Practical questions for brands to gut-check their measurement strategy, such as verifying if summed platform-attributed revenue exceeds actual sales

  • Common flags of broken retail media measurement, and the need to match ad spend and goals to brand objectives rather than vanity KPIs

MENTIONED IN THIS EPISODE

Connect with Acadia’s Head of Analytics, Sally Kazin

Connect with Acadia’s Director of Retail Media, Ross Walker

Connect with our host, Julie Spear

Connect with our host, Jordan Ripley

Learn more about Acadia

Season 2Julie SpearComment