How to Compare Case Studies From SEO Agencies

Three case studies land on the desk. Every one of them checks out.

Nobody cropped a screenshot. The dates line up. Each client is named. The named clients would take your call. So now what? You are holding three true documents about three different websites.

The numbers do not line up. Staring harder will not make them.

What This Page Grants Outright

Whether the proof is real at all is a separate job. Ask for the URL rather than the industry. Check that the win landed after the contract started. Strip the branded searches out before you believe a traffic figure. That work is covered properly elsewhere on this site. None of it gets repeated here.

One more thing gets granted. A result belongs partly to the client. The site somebody inherited. Whichever market it sits in. Whatever the business already sold before an agency turned up. That argument has its own page too.

So take the hardest version of the problem. Three case studies, all accurate, all fairly reported. They still refuse to sit side by side.

Three Decks, Three Different Endings

Open each one. Then skip to the last slide.

The first ends on a ranking. Position fourteen to position three, on a term the owner cares about.

The second ends on traffic. Organic sessions over a year, with a chart climbing left to right.

The third ends on booked work. Phone calls counted. Quote requests counted beside them.

Roughly the same service sits on all three covers. Local work for a trades business, give or take. Three agencies looking at one kind of problem, then choosing three different places to stop the story.

None of those three endings is wrong. Each is a legitimate way to describe a good year. Only notice that you cannot put them beside each other. There is no exchange rate between a ranking and a phone call.

The Number Was Inherited, The Ending Was Chosen

Here is the split worth carrying into every deck you open.

Everything numeric in a case study got handed over. Where the site started. How crowded that market already was. Whether the business had a name people typed into Google before anybody optimized anything. An agency works inside those conditions. It does not pick them.

The ending works differently. Somebody sat down with the whole year visible in front of them. Then they decided which measurement this story climbs to.

That decision got made at the agency, about the agency’s own work, with nothing forcing the answer. So the number tells you about a website. Meanwhile the choice of number tells you about the people you are thinking of hiring.

Which is the field to compare. It is also the only one on the page that survives being moved from one client to another.

Read the Unit, Not the Size of It

A big figure and a small figure prove nothing against each other. Different sites. Frequently different years. Sometimes different countries.

So stop reading the figure. Read what the figure is a figure of.

An Ending on Rankings

Positions are the measurement an agency controls most directly. They also move without anybody buying a thing.

A deck that stops at position three has stopped one step before the question the owner actually asked. Nothing wrong with that. Rankings are sometimes all a client ever agreed to be measured on.

Still, notice where the story ended. It ended where the agency’s control ended.

An Ending on Traffic

Sessions sit one step further out. Somebody has to rank first. Then somebody has to be clicked.

Traffic is also the easiest large number in the business to produce. A site can win a pile of visits for questions nobody buying anything would type. Watch whether the deck says which searches brought those people. A traffic ending with no query list beside it is a number without a subject.

An Ending on Calls and Revenue

This ending costs the most to write. Somebody had to get into the client’s phone log. Attribution had to be argued about with whoever owns the analytics. Then the client had to agree to publish the figure at all.

Rare, for those reasons. Rarer still on a small account. Which is why it is worth more than whatever size of number ended up attached to it.

An Ending on What Did Not Happen

Occasionally a case study ends with nothing gained. A migration finished and traffic held flat. Elsewhere a penalty lifted, leaving the site roughly where it had been.

Read that one twice. An agency willing to build its showcase around a year of holding steady has told you how it defines a good year. That is a lot to learn from a deck with no growth chart in it.

Somebody Will Say the Client Picked the Measurement

Often true. Plenty of case studies report whatever the client agreed to be reported on, months before any work began.

Only follow the objection through. Then the deck records what an agency and a client settled on together, in a room, at the start. That is the arrangement you are about to enter yourself.

So the objection does not remove the signal. Instead it moves the signal one step back, into the scoping conversation. Which is a conversation you will also be sitting in.

Somebody Will Say to Ask Them All for the Same Number

Fair. Send one email to all three agencies. Organic revenue over twelve months, every time, no substitutions. Now the answers compare.

Do it. Only do it second.

The moment you name a measurement, three agencies produce that measurement. Whatever each would have reached for on its own is gone, overwritten by your instruction. What comes back is a clean comparison of who can pull a report on request. Worth knowing. Not the same finding.

So read the decks as they were written first. Write down what each one climbed to. Then send the email.

Compare One Agency’s Decks Against Each Other

There is a second pass. It never leaves a single agency.

Line up everything one firm has published. Four case studies. Maybe five. However many sit on the site. Now check whether they end the same way.

A set that always lands on the same measurement means somebody decided years ago what this company counts as a win. Every client since has been held to that definition.

A set where each deck ends somewhere different means something else entirely. Each engagement got measured on whatever it happened to produce. The story got written after the year, arranged around the best available number.

Neither pattern disqualifies anybody. Only the second one warns you that your goal will get named at the end rather than at the start.

What a Missing Case Study Is Not

A small firm has fewer of these. A solo practitioner may have none written up at all.

Writing case studies is a marketing job. It costs a week nobody is paying for. That week comes out of client work. So absence proves very little on its own.

Ask for a client’s phone number instead. A reference answers in four minutes what twenty slides spend their whole length implying.

The Reading Order

Skip to the last slide of each deck. Write down the unit, never the number.

Then ask why that unit and not the one above it. Rankings instead of traffic. Traffic instead of leads. There is usually a reason. Sometimes the reason is that the next measurement out did not move.

Put the three units in a column of their own. That column is your comparison. The figures beside them describe three different websites. They were never going to line up.

Send the standardizing email last. Read the answers against the column you already wrote.

Where Comparing Case Studies Stops

None of this decides who is competent. A firm can define a win precisely and still run the work badly.

It settles nothing about price either. Two agencies ending on revenue may quote figures four times apart, for reasons that have their own page.

And no case study tells you what that team would do on your site. Your market is not the one in the deck. Nobody outside the room knows how much of that year belonged to an agency. Some of it belonged to a business that was already growing.

Comparing SEO Work in Calgary

SEO Company To-The-TOP! has been doing this work in Calgary SEO since 2007. Solo, which keeps the arithmetic short. The person reading your site is the person writing on it, with no account manager translating between the two.

Ask about the ending here as well. Position reporting arrives monthly, against terms agreed before the work starts, rather than against whichever number looked best in month nine. The SEO portfolio shows keywords this work has reached, in public, with no form standing in front of it.

Every engagement opens the same way. A website audit comes first. Then keyword research, which is where the measurement gets named. Deciding which searches deserve a year of attention is also deciding what winning will look like. Nothing about it moves quickly. Three to six months before meaningful movement, longer on a site carrying technical debt. Where a business needs customers this quarter, a Google Ads campaign runs alongside the organic work rather than instead of it. That is how search engine optimization tends to work across Alberta and British Columbia both.

No guarantees on positions. Anybody handing you a date is handing you a guess. The same thing happens with Google Ads case studies, incidentally. Read the ending on those too.

Common Questions About Comparing SEO Case Studies

Can two SEO case studies ever be compared directly?

Only where two sites started in similar places. Same market. Then the same year. That almost never happens. Compare what each deck chose to measure instead of comparing the results themselves.

What is the most useful thing on an SEO case study?

The last slide. Whatever it climbs to is that agency’s own definition of a good result. The definition got chosen rather than inherited from the client.

Should I ask every agency for the same metric?

Yes, after reading their case studies as written. Naming a metric first replaces the one signal that belonged to them with a signal about who owns a reporting tool.

Does a missing case study mean an agency is hiding something?

Rarely. Writing them is unpaid marketing work that small firms skip in favour of client work. A client reference covers the same ground faster.

What if every case study from an agency ends on rankings?

Then rankings are what that firm counts. Ask what traffic and leads did on those same accounts. A pause before the answer is part of the answer.

How many SEO case studies should I read before choosing?

Enough to see whether one agency ends its stories the same way twice. Two decks show you a pattern or the absence of one. Ten mostly repeat the finding.

Contact SEO Company To-The-TOP! in Calgary

Questions about anything in this article, or about your own rankings? Talk to a Calgary SEO specialist directly.

Phone: (403) 308-5949
Address: 1509 14 Ave SW, Calgary, AB T3C 0W4

Hours:
Monday to Friday: 10:00 am – 7:00 pm
Saturday: 12:00 pm – 4:00 pm
Sunday: closed

Greg Ichshenko

Calgary SEO expert and digital marketing specialist,
developing advertising strategies for businesses of all sizes

(403) 308-5949

greg@to-the-top.ca
1509 14 Ave SW, Calgary,
AB T3C 0W4

    Submit your request or question, and I will get back
    to you shortly

    Please prove you are human by selecting the heart.