Skip to content
Enjoy 20% off for 12 months on all plans. Use promo code: HYPERGROWTHClaim it

Lesson 1 of 4: How Google ranks a page

Crawl and index in SEO: how Google ranks a page

Crawl, index, rank: the three steps every page goes through and where most sites quietly fail.

7 min readBeginnerUpdated 2026-10-26

Picture two businesses that publish the same kind of page on the same day. A month later one sits on the first page of Google and the other has never been seen. Rarely is the writing to blame. Almost always the cause is one of three steps that happen before ranking, and most advice jumps straight past them.

Every page goes through the same pipeline. Google finds it, then understands and stores it, and only after that decides where to show it. Fix the pipeline and ranking becomes a contest you can win. Ignore it and nothing else you do counts.

Step one: Google has to find the page

Google discovers pages by following links and by reading the sitemaps you submit. Googlebot, its crawler, starts from pages it already knows and follows the links on them. Whatever it finds goes into a queue. A page that nothing links to and that isn't in your sitemap is invisible, however good it is.

Two things decide whether your page gets crawled at all.

  1. Something points to it. That can be your navigation, another page on your site or another site entirely. Internal links are the ones you control, so give a new page a link from a page Google already visits regularly, typically your homepage or a hub page.
  2. You haven't told Google to stay away. Your robots.txt file can block crawlers from whole folders, and a page can carry a noindex tag that says "don't store this one". Both are useful on purpose and disastrous by accident. Plenty of "why doesn't my page rank" mysteries end with a developer finding a stray block left over from the site launch.

Google also doesn't crawl everything at once. Large sites are visited on a budget, so pages buried many clicks from the homepage get seen less often. Keep the pages that matter near the top of the site.

Step two: Google has to understand and store it

After Googlebot fetches a page, Google renders it, which means it runs the JavaScript roughly the way a browser would. It reads the content and decides what the page is about, then saves that understanding in its index. Only indexed pages can show up in results.

Indexing fails quietly more often than people expect. Search Console reports "Crawled, currently not indexed" when Google fetched a page and chose not to keep it. Usually the page looked thin, duplicated, or too close to one already in the index. Two product pages that differ by one word are a typical case, and so is a tag archive listing the same posts as a category page. A location page copied from another city with the town name swapped fits too. Google reads each of these as a version of something it already has, so it keeps one copy or none.

What helps Google understand a page:

  • One clear topic per page, stated in the title tag, the main heading and the first paragraph, in words a searcher would use.
  • Text that a crawler can read. Content that loads only after a click, sits inside an image, or depends on JavaScript that fails on the server may never be seen.
  • A canonical tag naming the page's preferred URL, so duplicates created by parameters or trailing slashes point back to one page.
  • Structured data where it describes something real, such as a product or a local business. It won't make a page rank, but it removes doubt about what the page is.

Step three: Google decides where to show it

Ranking comes last. For each search, Google pulls candidate pages from the index and orders them using a mix of signals. Its own documentation groups them into families. The first is whether the content matches the meaning of the query. The second is whether the page and site look trustworthy for the topic, where links and mentions from other sites carry a lot of weight. Then there's usability: does the page load quickly, work on a phone and stay free of intrusive pop-ups? The last is the searcher's own context, such as their location and language.

Two of these families are where you can move fastest.

Relevance to the query. This isn't keyword density. It's whether the page answers what the searcher meant. Someone searching "best running shoes for flat feet" gets little from a page that opens with the history of running shoes, and a page that names a few shoes and explains each choice on the first screen will beat it. Search intent is the whole game here.

Trust from the rest of the web. Google treats links and mentions from other sites as votes of confidence, weighted by how relevant and trusted the voter is. Trust builds slowly, which is why a new site with better content can trail an older one for months. The later chapters on authority cover how to earn it.

Ranking is no longer a single list, either. Depending on the query, the results page mixes classic blue links with a map pack, shopping results, videos and AI-generated overviews that cite a handful of pages. Each format has its own rules, which is why a local business and an online store need different playbooks.

Where sites quietly fail

Audit enough sites and a pattern appears. The pages that don't rank are rarely bad pages. Usually they fall into one of these groups:

  • Pages that exist but have no links pointing to them, so Google visits rarely or never.
  • Pages Google fetched but refused to index because they duplicate something else on the site.
  • Pages that target a search their content doesn't satisfy.
  • Good pages on a site the rest of the web has never mentioned.

Each problem has a fix, and each fix belongs to a different chapter of this academy. Starting here means that when a page isn't ranking, you check the pipeline before you rewrite the words.

Frequently asked questions

How do you fix "crawled, currently not indexed"?

The status means Google fetched the page and decided not to keep it. Look for the usual causes first: thin content, or a page that duplicates or closely resembles another on your site. Make the page distinct and give it a clear single topic. Add a link from a page Google visits often, set a canonical if duplicates exist, then check that no noindex tag remains.

What is an SEO crawl?

It's Googlebot visiting your pages. The crawler starts from pages it already knows, follows the links on them, and queues whatever it finds. Your sitemap gives it a second route to pages. Crawling only fetches a page; Google still has to understand and store it before the page can appear in results.

What is crawlability and indexing?

Crawlability is how easily Google can reach a page. Internal links and a sitemap help, while a robots.txt block hurts. Indexing is whether Google reads the page, understands it and stores it. A page can be crawlable and still go unindexed if Google judges it thin or duplicated.

Does being indexed mean a page will rank?

No. Indexing only makes a page eligible. Ranking then depends on how well the content matches the query, how much the web trusts your site and how usable the page is.

What to take away

  • A page must be found, indexed and then ranked, in that order, and most ranking problems are really finding or indexing problems.
  • Internal links and your sitemap decide whether Google sees a page at all; robots.txt and noindex can switch it off by accident.
  • Google indexes pages it can read and understand as distinct; duplicates and thin variations get dropped.
  • Ranking rewards pages that answer the searcher's real question on a site other sites trust, and it's a different contest for each result type.

Next

Now that you know how Google decides, see how AI assistants make a similar decision with different sources in How AI search picks its sources.

Free tools this lesson uses

Saved in this browser only.

Chapter 1: How Google and AI search decide who shows up

All 9 chapters