Most brands evaluate creative agencies on the wrong criteria. They look at the reel. They look at the price. They look at whether the case studies mention a recognizable name. None of that tells you whether the agency will actually move your numbers, and by the time you find out, you've usually burned two or three months and a meaningful chunk of testing budget finding out the hard way.
Creative is now the primary lever in Meta performance. Targeting has been mostly automated away, and the system rewards accounts that keep feeding it genuinely diverse, high-quality creative. That makes the agency you hire to produce that creative one of the highest-leverage decisions in your marketing stack, and one most brands still make on instinct.
The problem is that almost every agency's pitch deck says the same things: strategic, data-driven, full-funnel, creative that converts. None of that language is a reliable signal, because it costs nothing to say and everyone says it. What actually separates a partner who moves your account from one who quietly drains your budget comes down to a handful of specific, checkable things, most of which won't show up in the pitch at all unless you ask directly. Here's what to actually look for.
Are They Doing Creative Strategy, or Is That Still Your Job?
A lot of agencies market themselves as creative partners but are really just execution shops. You hand them a brief, they design or film what the brief says, and the next round of concepts is still your responsibility to come up with. That's a legitimate service, but it's not the same thing as a creative agency, and it's worth knowing which one you're actually hiring before you sign anything.
Ask directly: who comes up with the next concept? Who decides what gets tested next and why? If the honest answer is "you tell us what to make," you haven't hired a creative strategy partner, you've hired execution help, and the strategic thinking, the part that actually determines whether your account improves, is still sitting on your desk. That's fine if you already have someone internal doing that work and just need hands to build it. It's a much bigger problem if you were hoping the agency would carry that load, because now you're paying agency rates for what's functionally freelance production, and every week without a strategist behind the work is a week of testing budget spent without a real hypothesis behind it.
The clearest way to find out: ask a prospective agency to walk you through how a brand-new concept gets created from scratch, from the point where nothing exists yet to the point where a script or storyboard is ready to shoot. If that process starts with you supplying the idea, that tells you everything you need to know.
Are They Actually In Your Account, or Just Taking Orders?
The agencies that move accounts forward are the ones living inside your data, not just your inbox. They're in Ads Manager reading hook rates and thumb-stop ratios. They're tracking where people drop off inside a video. They're pulling patterns across your best and worst performers and turning those patterns into frameworks, a testing roadmap, and specific briefs, not vague creative direction, but "here's exactly what we're making next and here's the performance data that led us here."
The alternative looks like this: you send a list of assets you want made, they get made, and the account's actual performance data never really factors into what gets produced next. That's not a creative partnership, that's renting designer time with extra steps. It's a fine arrangement if that's genuinely all you're looking for, but it's a materially different, and usually more expensive, service than what most agencies imply they're providing when they pitch you.
Before you sign, ask to see a redacted example of a real testing roadmap or creative brief from an existing client. A brief built on data reasoning looks different from a deliverables list. If what you're shown reads like "make 3 statics and 2 UGC videos" with no explanation of why, that's your answer.
See how we broke down the account structure of three brands spending $1M-$3M a month for a sense of what that kind of data-driven thinking looks like at real scale.
Do They Have Real Domain Expertise in Your Category?
Creative that converts for a $40 supplement doesn't automatically translate to a $200 skincare device, a subscription meal kit, or a considered-purchase home good. The hooks, objections, proof points, and even the pacing that work are category-specific, and an agency without real experience in something close to your category is going to spend your budget re-learning lessons another client already paid for.
Push past "we've worked with DTC brands" as an answer, because that phrase covers everything from $2 phone cases to $2,000 mattresses and tells you nothing. Ask for specific brand examples in your category or an adjacent one, and then ask what actually worked and why. A real answer is specific: which hook types performed, which objections had to be addressed head-on, how the format mix shifted once they understood the audience. A vague answer, or one that avoids naming actual results, is a sign the category expertise is more marketing than substance.
Do They Make One Kind of Creative, or Many?
Some agencies over-index on a single format because that's what their team is actually built to produce well. All UGC. All static. All one visual style, dressed up differently each time. It can look diverse on a sales call and still be structurally narrow once you're a few months into the retainer.
This matters more now than it used to. Meta's ad delivery system increasingly rewards genuinely distinct creative concepts, different angles, different formats, different visual identities, over volume of similar-looking assets. An agency that only produces one type of creative caps your account's creative diversity no matter how good any individual asset is, because the system needs range to find new audience pockets, not more variations on the same theme.
Ask to see a genuine breadth sample: statics, UGC, animation or motion work, advertorial-style creative, testimonial-driven formats, ideally all pulled from recent client work rather than an old portfolio reel. If everything you're shown looks like a version of the same thing, that's what you'll be getting for your account too.
How They Bill You Matters More Than It Seems
Two billing models dominate this industry: a flat retainer, or a percentage of ad spend. On paper, percentage of spend sounds aligned, the agency only makes more money if you're spending more, which presumably means things are working. In practice, it creates a real budget risk that most brands don't think through until it happens to them.
Here's the scenario: a campaign starts working, and a brand scales spend from $50,000 a month to $300,000 or $400,000 a month within a matter of weeks, because that's how quickly a genuine winner can scale on Meta. If your agency is billing a percentage of that spend with no cap, your creative bill just became an enormous, unplanned line item that nobody budgeted for, even though the ads are performing well. That's not a hypothetical. It happens constantly to brands scaling fast, and it creates a real internal finance and operations headache regardless of how good the ROAS looks.
If an agency's model is percentage of spend, ask directly whether there's a cap. If there isn't, understand that you're carrying open-ended financial exposure the moment something starts to work, which is exactly the moment you don't want a budget surprise. A flat retainer removes this risk entirely. Your cost is predictable no matter how far you scale, and it also removes a subtler issue: a percentage-of-spend model can create, even unintentionally, incentives around your budget that aren't purely about what's best for your account.
You're Not Licensing the Work, You Own It
Read the contract closely here, because this is an easy detail to miss. Some agency agreements are structured so you're effectively licensing the creative for a period of time, or usage rights are limited to certain platforms or a set duration, sometimes tied to keeping the retainer active. Make sure your agreement states outright that you own everything produced, permanently, with no continued-payment requirement to keep using it and no restriction on where or how long you can run it.
This matters more than it seems like it should in the moment. Agencies get acquired, contracts end, priorities change. You want the assets that actually performed, the ones you spent real budget proving out, to remain fully yours regardless of who's making your ads next. If ownership isn't explicit in writing, assume it isn't guaranteed.
Who Are You Actually Talking To?
A lot of agencies put an account manager between you and the people actually producing your creative. That's fine for status updates and scheduling. It's a real problem for creative quality, because the person relaying your feedback usually isn't the person who understands why a concept isn't landing, or what specifically needs to change to fix it. Feedback gets diluted every time it passes through an extra layer of translation, and creative work suffers for it.
Ask plainly: will you be talking directly with the creative director and the designers or editors working on your account, or only through an account manager? Direct access means faster, more accurate iteration. It also means you actually know who's making your ads, rather than trusting a relayed summary of a conversation you weren't part of.
Is the Design Work Offshored?
This isn't a moral judgment, it's a practical one. Offshored design work is almost always priced lower, and there's a reason for that. Two real costs tend to show up once you're actually working together: output quality can be less consistent, and communication gets harder across time zone gaps and cultural distance from your target market.
That second point matters more for ad creative specifically than for most other creative work. Copy that sounds genuinely native, a piece of slang, a cultural reference, a joke that lands, is harder to nail consistently from a team unfamiliar with the day-to-day culture of your actual customers. It's not that offshore teams can't do good work, plenty can. It's that the risk profile is different, and it's worth knowing upfront rather than discovering it three months into a retainer. Ask directly where the team actually producing your creative is based.
The Questions Worth Asking, All in One Place
If you're evaluating more than one agency, run each one through the same list:
- Who comes up with the next concept, you or them?
- Can you show me a real testing roadmap or creative brief, and does it reference actual account data?
- What have you made for brands in my category, specifically, and what worked?
- Can I see recent work across multiple formats, not just one style dressed up differently?
- Is billing a flat retainer, or a percentage of spend, and if it's the latter, is there a cap?
- Do I own everything you produce outright, with no restrictions?
- Will I work directly with the creative team, or only through an account manager?
- Is the design work done in-house, and if not, where?
Any agency worth hiring should be able to answer every one of these clearly and specifically, without hedging.
The Bottom Line
The wrong creative agency doesn't usually fail loudly. It fails quietly, showing up as flat account performance, ad fatigue that never gets ahead of itself, and months spent without a clear reason why any given concept was made. The right one operates as a genuine extension of your team: in your data, thinking in frameworks and testing roadmaps instead of one-off requests, producing real format diversity, and giving you direct access to the people actually doing the work.
For a full look at how a process like this actually runs month to month, see how our creative process works end to end.
At Biddyco, this is how we're structured on purpose. You work directly with our creative directors and designers, not an account manager relaying notes. Our billing is a flat retainer, so scaling a winning campaign never turns into a surprise bill. And everything we produce is yours outright, no licensing, no restrictions. If you're evaluating a creative agency for Meta ads, run them through the list above first, for brands spending $100k-$5M+/month, the difference between a real creative partner and rented designer time is usually the difference between an account that scales and one that plateaus.
