Need help?Jamie

SEO

Indexation vs. Ranking: Why Your Page Isn't on Google

Page not showing up on Google? First find out whether it’s missing from the index or indexed but ranking low, because each one needs a different fix.

Illustration of a marketing search strategy workspace.

SEE HOW WE CONNECT THE PIECES

Explore the decisions
behind our plan.

From a useful page to a relevant searchUseful websiteRelevant discoveryCRAWL · UNDERSTAND · CONNECT
  1. Useful website
  2. Crawl and understand the page
  3. Connect it to a relevant search
From a useful page to a relevant search

If a page isn't indexed, Google can't show it at all. If it's indexed but rarely shows up, the problem is relevance or competition, and a page that redirects is a third case. Trojan Digital Marketing, based in Indianapolis, has more than 1,400 live websites, and we check which state a page is in before anyone rewrites headlines or buys content.

We follow the path from a working URL to a page Google can reach, index and show for the right searches. That order stops you paying for new copy when a setting blocks the page, or for technical repairs when the content misses the question. If a page you need has vanished from Google, the first strategy call is free, and during business hours we aim to reply within five minutes.

Use a sequence that separates eligibility from performance

Make the next step usableName1Email2Send inquiry3
1. Name
Move to the name field.
2. Email
Keep keyboard focus visible.
3. Send inquiry
Complete the action without a mouse.
Make the next step usableVisible focus and a logical control order help a person navigate without a mouse. Test the complete action.

Indexation means that a search system has selected a version of a page for its index. Ranking concerns how eligible content is ordered or selected for a particular search. Discovery and crawling come earlier: the system must learn about a URL and obtain its content before it can evaluate that content. These are related processes, but none is an interchangeable synonym for the others.

We work in this order: availability, discovery, crawl access, indexing permission, canonical selection and then query relevance. It's our diagnostic order, and Google's own processing doesn't always run in a straight line. If the available evidence establishes a failure early in the sequence, investigate that failure before spending effort on a later stage.

  1. Identify the exact public URL and the page a visitor ultimately reaches.
  2. Compare Google's recorded state with the currently served page.
  3. Check the effective controls and content available for that URL.
  4. Determine whether another version appropriately represents the same content.
  5. Investigate query relevance and demand once the intended representation is established.

Write a separate outcome for each stage. “The public page loads with the intended service explanation” is an availability check. “Google selected this URL as canonical” is an indexing observation. “The page attracts relevant searches” is a performance question requiring a reporting period and a defined audience.

Confirm the exact page you mean

We start by copying the full URL of the page you want customers to visit, then check whether it opens, redirects or errors, and note where it lands. Similar paths, trailing slashes, old domains, and campaign parameters can make two people believe they are discussing the same page when they are looking at different versions.

Read the visible page after it loads. Confirm that the main content, navigation, and call to action appear as expected. A successful response from a server does not establish that the page contains the right information. A template error can return a normal looking status while showing an empty or irrelevant body.

Keep a brief record of the symptom: the URL, date, observed behavior, and the business impact. A statement such as the service page redirects to an obsolete package is much more actionable than the website has an SEO problem.

Inspect the response and the rendered content

We ask the website maintainer to check the response for the exact URL, including any redirect chain. Then inspect the final page as a visitor. A page that returns an error requires different handling from a retired page intentionally directing visitors to a replacement. A page that returns successfully but displays an empty search template needs a content delivery investigation.

Record what is missing. For example, the navigation may appear while the service description fails to render, or an appointment widget may cover the only meaningful text. Capture the relevant state and the conditions that produced it. “The page looks strange” is difficult to reproduce; “the service body is empty on a fresh mobile visit” gives the maintainer a useful starting point.

A representative sample helps establish scope. Compare the affected page with another using the same template and one using a different template. If the issue repeats within a template, a shared correction may be appropriate. If it affects only one record, investigate that record before modifying the entire publishing system.

Check the indexed state and the live state separately

Google's URL Inspection tool provides information about the indexed version and offers a live test. These are different views: one describes what Google knows from its processing, while the other helps examine current accessibility. Consult the official URL Inspection documentation when interpreting the results.

We record the result before changing anything: the selected canonical URL, any stated exclusion reason and whether the live page differs from the indexed one. An update made yesterday may not yet be reflected in the indexed view. Conversely, a page can remain in an index while its live version has developed a new problem.

We don't treat a request for indexing as a diagnosis. First understand why the page is absent or represented by another URL. Repeated requests cannot replace correcting an unintended block, an invalid destination, or a page with no useful content.

Read exclusion labels as states, not automatic penalties

Google's Page indexing report explains reasons a URL may not be indexed. Some are expected, such as an alternate version with an appropriate canonical. Others identify an access problem or content awaiting further processing. A large excluded total does not by itself establish a site quality failure.

Reported stateFirst questionBounded next step
Unknown URL
Can the intended page be discovered through the site?
Check relevant links and the correct sitemap entry
Discovered, currently not indexed
Has Google crawled this URL yet?
Review discovery context and any broader serving problems
Crawled, currently not indexed
Is the page useful and distinct from indexed alternatives?
Inspect content and duplication without assuming a penalty
Alternate with appropriate canonical
Is the preferred version the one the business intends?
Confirm the destination before treating exclusion as a defect
Excluded by noindex
Was exclusion deliberate for this page?
Have the responsible owner confirm the intended policy

A “crawled, currently not indexed” label does not reveal one universal cause or a guaranteed fix. The documentation says the page may or may not be indexed later and does not require repeated crawl submissions. Build a hypothesis from the page's actual content and relationship to the site. We'd never rename the URL over and over to try to reset the status.

Inspect access controls with their actual purpose in mind

Make account access explicitYourbusinessDomainWebsiteAnalyticsRecords
Domain and website
Document ownership and access.
Analytics and records
Define access and the handover.
Make account access explicitDomain, website, analytics and customer records need clear ownership and a workable handover.

Check whether a robots rule, page level indexing directive, authentication requirement, or delivery layer restriction prevents the intended access. These mechanisms are not interchangeable. Google's robots.txt guidance explains that crawl blocking is not a reliable way to keep a URL out of search, and robots.txt is not a security mechanism.

Ask the person managing the site to explain the effective rule for the specific URL. Avoid changing a site wide control simply because one page has a problem. A rule may intentionally protect a staging environment or limit a section that should remain unavailable. Document the purpose before modifying it.

If AI crawler access is part of the concern, use the crawler access decision guide to distinguish search inclusion, training preferences, and private content protection. A general search problem should not be diagnosed through an unrelated AI bot setting.

Distinguish crawl rules, indexing directives, and privacy controls

A robots.txt rule concerns crawling. A noindex instruction concerns inclusion in search after the crawler can read that instruction. Authentication protects access to private material. A firewall or delivery layer can also prevent a crawler from reaching a public page, sometimes unintentionally. Ask which mechanism is actually producing the observed result.

Google's noindex documentation explains that the crawler must be able to access the page to see the directive. Blocking the URL in robots.txt while relying on a page level noindex can therefore frustrate the intended outcome. Keep private content behind appropriate access controls rather than treating either search directive as security.

For a public page accidentally excluded by a template setting, correct the setting at its true source and verify the rendered output and response headers. For an intentionally private page, the goal is continued protection, not search inclusion. Documenting that decision prevents the next audit from proposing the opposite change.

Check whether another URL represents the content

Compare duplicate and near duplicate versions. Does the page identify a different preferred URL? Do internal links point to an older version? Does the sitemap disagree with the live navigation? These clues can reveal an inconsistent publishing process rather than a missing topic.

In a hypothetical site migration, an old service URL might remain in the sitemap while navigation points to the new page and a canonical annotation names a third version. The first task would be to decide which URL should represent the service and align the signals. Rewriting all three pages would leave the underlying disagreement intact.

Handle this work with the website team, particularly when templates or redirects affect many pages. A correction should include a check that the intended page remains available to customers and that important internal paths reach it.

Align the preferred version without erasing useful differences

Google's canonicalization guidance describes methods for signaling a preferred version, including redirects, canonical annotations, and sitemap inclusion. These signals should support a coherent choice. A canonical annotation is a signal rather than a command that guarantees Google's selection.

Do not consolidate two pages solely because their layouts look alike. A repair service and a maintenance service may share a template while answering different customer needs. Conversely, three campaign URLs showing the same service may be alternative versions of one page. Have the content owner identify the intended relationship before the technical owner changes signals.

Once the decision is approved, check the final destination, internal links, sitemap references, and relevant template output together. Retain a record of the old relationship and the reason for changing it. This makes a later investigation possible without guessing whether a surprising canonical was intentional.

Only then investigate competitive performance

When the intended page is indexed and accessible, examine the search demand and the page's purpose. Which queries and pages are visible in the available reports? Is the page appearing for the audience it was designed to help? Does it answer a buying question, a definition, a comparison, or a local availability question?

Read the content beside that decision. Check whether the title accurately introduces the page, the opening explains its purpose, and the body supplies enough specific information to be useful. More words are not automatically more helpful. A concise service explanation with clear conditions may serve the decision better than a long article on a loosely related topic.

Assign work from the evidence
Observed stateInitial owner
Broken URL or unexpected redirect
Website maintainer
Unintended access or indexing restriction
Technical site owner
Conflicting versions of the same content
Content and technical owners together
Indexed page addressing the wrong decision
Content strategist and service owner
Useful page with a small or changing audience
Measurement owner for further observation

Worked example: a migration problem mistaken for weak copy

Imagine a hypothetical consulting website that recently replaced an old service package. The marketing team reports that the new package page is not appearing as expected and proposes a longer article. A review finds three versions: the retired package URL still listed in the sitemap, the new page reached from navigation, and a canonical annotation on the new page that names the retired version. This scenario is invented to illustrate the workflow.

The content owner confirms that the new package is the intended current offer and that the retired URL has no independent customer purpose. The maintainer checks the responses and discovers that the old URL still serves its obsolete copy. The first useful change is therefore a coordinated migration correction, subject to the site's normal release process, rather than adding paragraphs to both versions.

  1. Record the old and new content states, the redirect behavior, and the current canonical observation.
  2. Approve the current package page as the intended customer destination.
  3. Implement the appropriate transition for the retired URL and align the new page's signals, navigation, and sitemap.
  4. Check that existing links reach useful content and that the new page's inquiry route works.
  5. Reinspect the live output, then observe Google's later processing separately from immediate functional acceptance.

If the current URL is subsequently selected but attracts searches for the retired package, that becomes a content and demand question. The team may need a clear explanation for returning customers or better wording about the new scope. The evidence has changed, so the next task can change too.

Set stopping conditions for the investigation

Close the immediate repair when its acceptance checks pass and the owner has documented what remains dependent on search processing. Keep a later observation task for indexing or performance. Reopening unrelated settings every day creates more uncertainty and may undo intentional behavior elsewhere.

Escalate when a representative sample shows a shared defect, when the live page cannot be inspected reliably, or when business owners disagree about which content should remain public. The escalation should name the unresolved decision and the evidence needed. It should not turn every isolated page concern into an open ended site rebuild.

Close the diagnosis with a bounded change

Write down the finding, the proposed correction, and how you will verify it. Separate immediate functional checks from later performance evaluation. Confirming that a page loads is immediate; judging whether revised content attracts more suitable inquiries takes a relevant observation period.

Connect the work to a search improvement plan with named responsibilities. If the page is accurate but losing usefulness, follow the content refresh decision process. The value of diagnosis is not a longer checklist. It is choosing work that addresses the page's actual state and leaving unrelated parts of the site alone.

Frequently asked questions

Does passing a live URL test mean a page will be indexed?

No. A live test helps assess current access and selected technical conditions. It does not guarantee indexing or predict which version Google will select as canonical.

Should every excluded URL be fixed?

No. Redirected, intentionally excluded, or alternate URLs may be behaving correctly. Evaluate the intended purpose of the URL and the version that should represent the content before assigning a task.

What if the page is indexed but receives few clicks?

Investigate the relevant queries, demand, search appearance, and customer decision the page supports. Confirm the comparison period and query mix before attributing the result to weak copy or a technical fault.

Sources & further reading

Need our help with this on your own site?

Request a free strategy call

The first strategy call is free, and during business hours we aim to reply within five minutes.