Every month, your agency sends a report. It has charts, numbers, percentage improvements, and a summary that reads something like: "Strong performance across all channels. CPCs decreased 12%. ROAS improved to 6.2×."
The problem isn't that these numbers are wrong. The problem is that they're carefully selected, and the numbers that would tell you whether your money is actually working aren't in the report at all.
After a decade working inside agencies and on the ad tech side, I can tell you: performance reports are almost always written to satisfy the client, not to inform them. Here's how to read them, and what to ask for instead.
The Metrics That Look Good But Mean Little
These are the numbers that dominate most agency reports. They're real, they're measurable, and in isolation they're mostly useless:
- Click-through rate (CTR). High CTR means people clicked your ad. It says nothing about whether they bought anything, whether they were the right people, or whether the clicks were worth what you paid for them.
- Cost per click (CPC). Lower isn't always better. If you're optimising for cheap clicks, you'll get cheap clicks from low-intent users. CPC is a cost efficiency metric, not a business one.
- Platform ROAS. This is the number agencies love most. It's calculated by the same platform that's trying to prove its own value, using an attribution methodology the platform chose. It is not the same as your actual return on ad spend.
- Impressions and reach. Useful for awareness campaigns with clear brand objectives. Irrelevant in a performance context. Often reported to fill space.
The Red Flags in Your Report
Beyond unhelpful metrics, there are active warning signs. If you see any of the following, dig deeper:
- FLAGNo split between new and returning customer conversions. If your agency can't tell you what percentage of conversions came from first-time buyers, they're optimising for conversions without caring where they come from. Retargeting existing customers at high ROAS looks great in a report. It doesn't grow your business.
- FLAGROAS reported without attribution window disclosure. A 7-day click, 1-day view attribution window will produce a dramatically higher ROAS than a 1-day click window. If the window isn't stated, assume it's set to maximise the number.
- FLAGPerformance compared only to last month. Seasonal businesses always look better in peak periods. Compare to the same period last year, or to an external benchmark, not to the previous month's trough.
- FLAGNo mention of what isn't working. A good report includes campaigns that underperformed and a hypothesis about why. If every section of your report is green, either the agency is hiding problems or they've optimised the reporting rather than the account.
- FLAGBudget pacing reported without efficiency context. "We spent 99.8% of budget" is not an achievement. Full pacing only matters if the spend was efficient. Agencies who highlight pacing are often filling space.
What to Ask For Instead
These are the five things to look for when auditing a reporting setup. If your agency produces all five, they are in the top 20% for transparency:
- Blended CAC (Customer Acquisition Cost). Total paid media spend ÷ number of new customers acquired. Direct, honest, comparable across channels.
- New-to-brand conversion rate. What percentage of conversions in any given month came from customers who had never purchased before?
- Attribution comparison. Show the ROAS under multiple attribution windows (7-day click vs 1-day click vs last-click) so you can see how sensitive the number is to methodology.
- Frequency report. Average frequency per user by campaign type, per week. This tells you whether you're burning your audience or reaching new people.
- Learning phase status. What percentage of your ad set budget is currently in the learning phase (i.e., not yet optimised)? A well-managed account keeps this low. A fragmented account keeps resetting it.
The Conversation to Have
"Can you show me what our blended CAC was this quarter, and how it's trended over the last 12 months?"
That question will tell you a lot, from the answer and from the reaction. An agency that manages accounts for business outcomes will answer immediately. An agency that manages accounts for platform metrics will tell you it is complicated.
A practical first step: Before your next monthly review, ask your agency to add three columns to their standard report: new vs returning customer split, blended CAC, and average frequency by campaign. If they push back, that's worth noting.
None of this is about distrust. Most agencies are not deliberately misleading their clients. But the incentive structure of the industry rewards metrics that look good, not metrics that are true. An independent audit creates a layer of accountability that the agency relationship, by design, cannot.
Find out what your report is actually telling you
A MediaAudit engagement includes a full review of your reporting setup, what's being measured, what's being hidden, and what you should be tracking instead.
Book a free discovery call