Why Google Crawls But Doesn't Index Your Pages — And What Small Businesses Can Do About It

If you run a small business website, you have probably seen this in Google Search Console: "Crawled – currently not indexed" on a large share of your pages. Not blocked. Not errored. Google just fetched the page, looked at it, and decided not to keep it. We run frontagevalue.com ourselves, so we watch the same numbers — and this status is the most common question small site owners bring to us.

Here's what that status really means, why Google has been indexing less since 2022, and what actually moves pages into the index — including what we do on this site.

What "crawled but not indexed" actually means

"Crawled – currently not indexed" is not an error message. It means Google's crawler fetched the URL successfully, but the indexing system chose not to store it. The page wasn't broken and nothing is blocking it — Google simply decided the page didn't clear its quality bar, or that it wasn't worth the crawl budget.

That decision has gotten dramatically stricter. Back in 2022, Google announced a shift in mission — from indexing the whole web to indexing "all the knowledge on the web". The Helpful Content update that followed was the first big wave of deindexing, and the threshold has kept climbing since. SEOs in a recent r/TechSEO thread described it as an ongoing purge: one site owner with an authority domain registered in 2001 saw his indexed pages drop sharply in the last year; a 20-year-old artist website reports less than half its pages indexed now, while Bing and Yahoo still show nearly everything. You are not alone, and your site is probably not broken.

Why Google is indexing less

Four patterns come up again and again — in the thread, in Google's own statements, and in our checks of other small sites:

1. JavaScript-heavy pages. If your content only appears after JavaScript runs, the crawler may fetch the page, see little useful text, and move on. One site owner in the thread moved from a client-side-rendered app to a server-rendered framework and said indexing "skyrocketed since then."

2. Duplicate-ish or thin content. Template pages, near-identical product descriptions, tag archives and filter combinations all look the same to Google — and now it keeps only the best version of each. If half your pages are variants of each other, the variants lose.

3. Publishing volume. Mass-produced content is the clearest signal of a factory site. SEOs in the thread explicitly warned against churning out hundreds of posts a day — Google treats volume as a smell, and pages from such sites are the first to be culled.

4. Crawl budget. Google spends a limited amount of time on each site. If the crawler wastes that time on low-value URLs, the pages you actually care about can be left waiting — sometimes for weeks.

What actually works — our checklist

There is no guaranteed fix — the thread's most experienced commenter was blunt about that. But the same fixes kept being repeated by people who saw real movement:

1. Serve real HTML. Static or server-rendered pages put your full content in the raw response. This site is built that way — every word of this post is in the HTML before any JavaScript loads. If you're on a JS framework, switching to server rendering or static generation is the single most cited fix.

2. Make every page earn its place. Merge or prune pages that don't offer something unique. A shorter site where every page answers a real question beats a long site full of filler.

3. noindex what shouldn't rank. Tag pages, filter combinations, thank-you pages, internal search results — if you don't want them in results, say so explicitly. That keeps the crawler focused on pages you do want.

4. Publish less, publish better. One strong, genuinely useful post outperforms ten rushed ones — and it's the only volume strategy Google doesn't penalize.

5. Update, link, prove. Refresh old pages, earn internal and external links, and make the trust signals visible — a real about page, a contact page, named humans behind the business (Google's E-E-A-T criteria).

6. Request indexing, then wait. Search Console's "request indexing" button works sometimes — not always, and not instantly. Indexing can take days to weeks. Don't spam the button.

7. Don't depend on Google alone. Every commenter who reported recovery also mentioned alternative channels. We submit every new post to IndexNow, which Bing, Seznam and Yandex pick up in hours — Google ignores it, but other engines respond. A small business can't afford to be hostage to one algorithm.

Reading your own Search Console report

The Page indexing report groups URLs into a handful of statuses. Knowing what each one means tells you whether you have a problem at all:

What we do on this site

We face the same numbers, so we apply the same checklist: static HTML pages, one thoughtful post at a time, no thin or duplicated pages, an about page with real people, and an IndexNow ping on every publish. We don't chase volume, and we don't pretend Google owes us anything.

That's the honest bottom line. Google's index is smaller and pickier than it was five years ago, and no trick guarantees entry. But the pattern is consistent: serve plain HTML, make each page worth keeping, earn links instead of generating pages, and build traffic channels you control. Do that, and the pages that matter will find their way in — on Google when it makes sense, and everywhere else sooner.