Need help?Jamie

Search strategy

How to Compare SEO Changes Without Inventing a Success Story

Build a reviewable before and after comparison that separates observed changes from the explanations you still need to test.

Illustrative business planning materials and calculator.

SEE HOW THE PIECES CONNECT

Explore the decisions
behind the plan.

THE TROJAN SYSTEMSEARCH
From a useful page to a relevant searchUseful websiteRelevant discoveryCRAWL · UNDERSTAND · CONNECT
  1. Useful website
  2. Crawl and understand the page
  3. Connect it to a relevant search
From a useful page to a relevant search

“Traffic increased after the update” is a useful observation. It is not yet proof that the update caused the increase. Demand, seasonality, query mix, competing pages, and other work can change during the same period. A responsible SEO review keeps those possibilities visible while still helping the business decide what to do next.

The Search Opportunity Finder can help organize exported rows. The method below works even if you compare two files in a spreadsheet. Start with the Search Console action plan workflow if you have not yet selected a specific improvement.

Write the expectation before changing the page

Give each part of the page a jobOfferEvidenceAction
Offer
Explain what the customer can get.
Evidence
Support the offer.
Action
Make the next step easy to use.
Give each part of the page a jobThe offer, evidence and contact route should work together on a small screen.

Record the observed problem, the proposed explanation, and the exact change. A hypothetical service business might write: people ask whether cleanup is included, but the page never explains it; adding the verified cleanup policy may help suitable customers evaluate the service. This is a clear proposition the team can revisit.

Keep the implementation date, page URL, old wording, new wording, and any related changes. If the company also changed its prices or started advertising, note those facts. A short change log is often more valuable than another chart because it prevents later memory from simplifying a complicated month.

Make the windows comparable

Use the same Search Console property, Web search type, dimension, and filters. Choose equal length periods when comparing raw counts. Where practical, keep the weekday mix similar. If the business is seasonal, add a separate seasonal comparison rather than assuming the immediately preceding period is a neutral baseline.

For unequal windows, normalize counts per day and retain the window lengths. A hypothetical twenty day period with 200 clicks averages ten per day. A thirty day period with 270 clicks averages nine per day. The second period has more total clicks but a lower daily rate. Presenting only the total would conceal that distinction.

Do not mix Queries and Pages totals as if they were interchangeable. Google documents grouping and aggregation differences in its performance report. Keep your comparison at the same level before interpreting the change.

Calculate differences in the correct units

Hypothetical measureBeforeAfterClear description
Clicks
100
120
20 more clicks; 20% increase
CTR
1%
1.4%
0.4 percentage point increase
Average position
12
9
Improvement of 3 positions in the average

Percentage points describe the direct difference between two percentages. A move from 1% to 1.4% is also a 40% relative increase, but that phrasing can sound larger than the underlying change. Show the starting and ending rates so the reader can judge the scale.

When the earlier count is zero, relative growth is undefined. Write “new in this export” and show the actual counts. A missing prior row may also mean it was omitted from that export; it does not prove the business had no prior impressions. Google's data discrepancy guidance explains why tables can be incomplete.

Look for a changed audience

Start with the decisionYour serviceFitTrustNext stepScopeEvidenceContact
Fit
Explain the service scope.
Trust
Show supporting evidence.
Next step
Give a clear contact route.
Start with the decisionOne service can lead to different questions about fit, evidence and the next step.

Review the queries or pages contributing most to the difference. If a company received attention from a news story, branded searches may account for a large share of the movement. If a seasonal question became popular, a guide may gain clicks without an improvement in the service page you edited.

Use a small comparison table to distinguish familiar demand from new query themes. Read the actual words. Avoid turning a single average into a claim that every page improved. For CTR specific questions, use the low CTR investigation guide to check intent and presentation.

Connect the review to business outcomes

Ask the people handling inquiries whether the questions, locations, and requested services changed. Use whatever reliable contact or booking records the business already maintains. Keep definitions stable: a submitted form, a qualified inquiry, and a signed customer are different events.

A page can become more useful while attracting fewer unsuitable contacts. A page can gain clicks while increasing support work. Neither situation is captured by declaring a winner from traffic alone. Write down what the business wants more of and what it wants less of before deciding whether to keep the change.

Report the conclusion in three parts

Separate observation, interpretation, and decision. An observation might be that matching period clicks increased from 100 to 120. The interpretation might be that clearer service information helped, while a change in query demand remains another explanation. The decision might be to retain the verified information and observe another comparable period.

This format lets a business act without pretending to have run a controlled experiment. If several changes happened together, say the result applies to the combined work. If the sample is thin, extend the observation period when that is useful rather than inventing precision.

Keep the files and change log together. Use the Search Opportunity Finder to prepare a fresh shortlist for the next cycle, and read how to create a marketing strategy to connect page work with wider priorities. Trojan's SEO, AEO and GEO services can build on a review that makes its evidence and limits clear.

Sources & further reading

Want help putting this to work?

Talk with Trojan

The first strategy call is free, and during business hours we aim to reply within five minutes.

Start with a website audit