Greg Ichshenko

Calgary SEO expert and digital marketing specialist,
developing advertising strategies for businesses of all sizes

(403) 308-5949

greg@to-the-top.ca
1509 14 Ave SW, Calgary,
AB T3C 0W4

    Submit your request or question, and I will get back
    to you shortly

    What Is Google Indexing in SEO?

    Google indexing is the stage in which Google analyzes a page it has crawled and stores what it learned in its index, the large database it draws on when it answers a search. In SEO terms, indexing sits between crawling, when Googlebot downloads the page, and serving, when Google decides whether to show it for a query, and a page that is not in the index cannot rank for anything. Being crawled does not mean being indexed, and Google states plainly that indexing isn’t guaranteed. This guide explains how the three stages fit together, how to check whether a page is indexed, what the statuses in Search Console mean, and which problems are worth fixing.

    How Googlebot finds pages through links and sitemaps before indexing

    Crawling, indexing and serving are three different stages

    Google’s own guide to how Search works describes three stages and says that “not all pages make it through each stage”. In the first, crawling, automated programs download the text, images and videos from pages Google has found. In the second, indexing, Google analyzes that content and stores the information in the Google index. In the third, serving, Google returns the indexed pages it judges most relevant to a search. Ranking happens only in that last stage, which is why an indexing problem can look like a ranking problem from the outside when the real issue is that the page never got that far.

    During indexing Google does more than file the page away. It reads the text and key tags such as the title element and image alt attributes, and it decides whether the page is a duplicate of another page or the canonical version. Google groups pages with similar content into a cluster and picks the one it considers most representative as the canonical, and that is the version that may appear in results. It also collects signals such as the page’s language, the country the content is local to and its usability. The same guide lists the common reasons a processed page is left out: the content quality is low, robots meta rules disallow indexing, or the design of the site makes indexing difficult.

    Google's indexing process from download to storage in the index

    How Google finds a page in the first place

    Before a page can be indexed, Google has to learn that its URL exists. Google describes three ways this happens: it already knows the page from an earlier visit, it extracts a link to it from a page it already knows (a category page linking to a new blog post, for example), or the site owner lists it in a sitemap. Links from other sites work the same way as internal links for discovery, which is one reason a brand-new page with no links pointing to it can wait a long time for its first visit.

    An XML sitemap helps, but Google is careful about what it promises. Its sitemap documentation says a sitemap helps search engines discover URLs “but it doesn’t guarantee that all the items in your sitemap will be crawled and indexed”, and that a small, well-linked site may not need one at all. In practice, a link from a page Google visits often, such as a service page or the blog index, is usually the quickest route for a new article on a small business site, with the sitemap as a backstop; neither guarantees crawling or indexing.

    Google also renders the page during the crawl, running its JavaScript in a recent version of Chrome, much as a browser would. Content that only appears after scripts run can still be indexed, but it adds a step that can fail. Since Google uses the mobile version of a site’s content for indexing and ranking under mobile-first indexing, anything left out of the mobile version of a page, such as a section the theme drops on small screens, is not used for indexing, although content placed in mobile tabs or accordions is fine as long as it is on the page.

    The Page indexing report in Google Search Console

    How to check whether a page is indexed

    There are two quick checks, and they answer different questions. The first is a search using the site: operator, such as site:example.com/your-page/. Google’s site: operator documentation says an indexed URL can show up for a site: query, “however it’s not guaranteed”, so a missing result is a reason to look closer rather than proof that the page is out of the index. It is a good rough check for a whole domain and a poor one for a single important page.

    The reliable check is the URL Inspection tool in Google Search Console, which is free for anyone who verifies ownership of the site. Paste the full URL and it reports whether the page is on Google, which canonical Google selected, when it was last crawled and which crawler type fetched it. Its live test shows whether the current version could be indexed, although Google notes that the live test does not check everything, including duplicate and canonical conditions. If you want to use Search Console beyond single pages, the Page indexing report (called the Coverage report in older guides) shows how many of the site’s known URLs are indexed and groups the rest by reason.

    A simple sequence works for most small sites:

    1. Inspect the important pages one at a time in URL Inspection, starting with the home page, the main service pages and anything published in the last few weeks.
    2. Open the Page indexing report and read the reasons listed under “Why pages aren’t indexed”, paying attention only to URLs you actually want in search.
    3. For any important page with a problem, fix the cause first, run a live test, and only then request indexing.

    What the statuses mean in practice

    Google’s help for the report says that “Not indexed is not necessarily bad”, and that line saves a lot of wasted effort. Most healthy sites have URLs that should stay out of the index, such as redirected addresses, old deleted pages, tag archives and the non-preferred copy of a duplicated page. The table below gives Google’s explanation of the statuses a business site most often sees, with a practitioner’s view of whether each needs action.

    Status in the Page indexing report What Google says it means Act on it?
    Crawled – currently not indexed Google crawled the page but did not index it; Google says this is common and “doesn’t necessarily indicate an issue” Only for pages you need in search. Improve what the page offers or merge it with a stronger page
    Discovered – currently not indexed Google found the URL but has not crawled it yet, typically because crawling then was expected to overload the site, so the crawl was rescheduled Usually wait. Add internal links from pages Google visits often if it lasts for an important page
    URL marked ‘noindex’ Google found a noindex rule and did not index the page Yes, if the page should rank. Remove the rule, then request indexing
    Blocked by robots.txt The site’s robots.txt file stops Google from crawling the URL Only if the block is a mistake. Google says such URLs are probably blocked on purpose
    Alternate page with proper canonical tag The page correctly points to another canonical page, which is indexed No. Google says “there is nothing you need to do”
    Duplicate, Google chose different canonical than user The page names itself as canonical, but Google picked another URL Check which URL you want to rank and make the signals agree
    Page with redirect The URL redirects, so only the target can be indexed No, unless the redirect is wrong
    Not found (404) The URL returned a 404 error Only if the page should exist, or if an important old URL needs a redirect

    To-The-TOP!’s own site shows how the “Discovered” status can look in practice. This article was first published in April 2026. When the URL Inspection tool was run on it on 24 August 2026, it reported “Discovered – currently not indexed”, and its first recorded impression in Google search came on 15 September 2026, about three weeks later. That confirms only that it had been indexed by then; the data does not show when Google crawled it or why the crawl waited, although Google says the usual reason for this status is a crawl rescheduled to avoid overloading the site. For a single page in that state, a good internal link and patience are usually more useful than repeated requests.

    Common reasons a page is not indexed, including noindex and robots.txt rules

    Why a page is not indexed, and what to do about it

    The causes that matter most on a small or mid-sized business site are few. The first is an indexing rule left in place by mistake. A noindex rule in the page’s robots meta tag or HTTP header tells Google to drop the page from results, and it is common on staging copies, on pages a theme or plugin hides by default, and on sites where the “discourage search engines” setting was left on after launch. Google’s noindex documentation is clear that the rule works only if Google can crawl the page and see it.

    That leads to the trap that catches many site owners. A robots.txt file controls crawling, not indexing, and Google’s robots.txt introduction says it “is not a mechanism for keeping a web page out of Google”. If a page carries noindex and is also blocked in robots.txt, Google never sees the noindex rule, and the URL can still appear in results if other pages link to it, without a description. The Page indexing report has a status for exactly this, “Indexed, though blocked by robots.txt”. To keep a page out of Google, allow crawling and use noindex, or put the page behind a password. To get a page in, remove both.

    The next cause is duplication. When several URLs carry the same or nearly the same content, Google indexes the one it picks as canonical and treats the others as alternates. Google’s canonical documentation ranks the signals by strength: a redirect and a rel=”canonical” link are strong signals, and inclusion in a sitemap is a weak one. When those signals disagree, for example a canonical tag pointing one way and the internal links pointing another, Google makes its own choice, so the fix is usually to make every signal name the same URL.

    The last common cause is quality. Google says its systems “prioritize the fast inclusion of high quality, useful content”, and a page that adds little beyond other pages on the same site or the wider web is a likely candidate for “Crawled – currently not indexed”. In practice, the most useful question to ask is whether the page deserves to exist on its own. If it overlaps heavily with a stronger page, merging the two and redirecting the weaker URL is often a better result than trying to force both into the index. A structured website audit is the usual way to find these overlaps across a whole site rather than one page at a time.

    Checking indexed pages with the site: search operator

    Crawl budget is rarely the problem on a small site

    Crawl budget comes up in almost every discussion of indexing, and on most business sites it is a distraction. Google’s crawl budget guide says it is intended for large sites with a million or more unique pages that change about once a week, medium or larger sites with 10,000 or more pages that change daily, and sites with a large share of URLs stuck at “Discovered – currently not indexed”. For everything else, it says that keeping the sitemap up to date and checking the Page indexing report regularly is adequate.

    Google describes crawl budget in terms of how much crawling a site’s server can handle and how much Google wants to crawl it, not a fixed number of requests per visit. The website of a typical Calgary contractor, clinic or professional firm is far below the size thresholds, so unless a large share of its URLs sits at “Discovered – currently not indexed”, crawl budget is unlikely to be the problem. Check the specific reason Search Console gives first; it is usually one of the causes in the previous section, or an access, redirect or server error. Faster pages and fewer redirect chains still help Google crawl more efficiently, and both are worth fixing for visitors anyway.

    Submitting a sitemap in Google Search Console

    How to ask Google to index a new or updated page

    Google’s page on asking for a recrawl describes two methods. For a few URLs, use Request Indexing in the URL Inspection tool, which requires owner or full user access to the Search Console property. For many URLs, submit or update a sitemap. Google adds that “crawling can take anywhere from a few days to a few weeks”, that there is a quota for individual requests, and that “requesting a recrawl multiple times for the same URL won’t get it crawled any faster”.

    Most importantly, Google says that “requesting a crawl does not guarantee that inclusion in search results will happen instantly or even at all”. A request is useful after a real change, such as a new page, a rewrite or a removed noindex rule, because it tells Google there is something new to look at. It is unlikely to help a page that Google has already crawled and decided not to index unless something on the page has changed, because the reason for that decision is still there. Google also states that it does not accept payment to crawl a site more often, so any service that promises paid or instant indexing in Google is promising something Google says it does not sell.

    Requesting indexing with the URL Inspection tool

    Where indexing fits in an SEO plan

    Indexing is a gate rather than a goal. Once a page is in the index, being indexed adds nothing more to its ranking, and the work moves on to whether the page answers the search better than the pages around it. Google says crawling after a request can take from a few days to a few weeks, and ranking after that has no fixed timeline, so a business that needs enquiries from a search term in the meantime may run a Google Ads campaign for that term while the organic page settles in. Paid results do not affect indexing either way.

    For most sites, a light routine covers indexing: inspect every new or rewritten page a week or two after publishing, read the Page indexing report once a month for anything unexpected among the URLs that matter, and treat a sudden rise in “noindex” or “robots.txt” exclusions as urgent, because it usually means a setting changed. SEO Company To-The-TOP!, a Calgary SEO and Google Ads firm founded in 2007, can help read what Search Console is reporting and decide which exclusions need action. Content that Google has not indexed cannot rank, however good it is, so if your pages are published but not showing up, call (403) 308-5949.

    Organic indexing status reviewed alongside paid search traffic

    Contact Calgary SEO Company To-The-TOP!

    Questions about anything in this article, or about your own rankings? Talk to a Calgary SEO specialist directly.

    Phone: (403) 308-5949
    Address: 1509 14 Ave SW, Calgary, AB T3C 0W4

    Hours:
    Monday to Friday: 10:00 am – 7:00 pm
    Saturday: 12:00 pm – 4:00 pm
    Sunday: closed