// guides / crawlability and indexing

Discovered, currently not indexed: what it means, how it differs from crawled, and how to fix it

Discovered, currently not indexed means Google knows the URL exists but hasn't crawled it yet, usually because Google expected the crawl to overload the site. Crawled, currently not indexed means Google fetched the page and chose not to index it at that time. Neither is automatically an error, and some URLs in both reports shouldn't be indexed at all.

By Muhammad Younus Updated

A beam of amber light scanning a row of glass page cards, with a few dim cards pushed out of the row
the short answer
$ discovered currently not indexed ✓ Discovered means Google knows the URL and hasn't crawled it yet; Google says the crawl was typically put off because it was expected to overload the site. Crawled means Google fetched it and didn't index it at that time.✓ Neither status is automatically an error. Archives, filters, parameters, feeds and thin duplicates belong in these reports, and forcing them into the index makes a site worse, not better.✓ Diagnose per URL: server health, links and URL volume for the first status; uniqueness, canonicals and rendered content for the second. Then validate the fix and give Google time to recrawl.
// 01 - start here

What is the difference between discovered and crawled, currently not indexed?

Both labels sit in the Page indexing report under Why pages aren't indexed, and both mean the URL isn't in Google's index. They describe different stages, which is why the same fix rarely works on both.

What is the difference between discovered and crawled, currently not indexed?
Compared onDiscovered, currently not indexedCrawled, currently not indexed
Google knows the URL existsYesYes
Google has crawled itNo, not yetYes
Google has indexed itNoNo, not at the time it looked
Google's usual explanationThe crawl was expected to overload the site, so it was rescheduledIt may or may not be indexed in the future
Last crawl date in the reportEmptyFilled in
First question to askCan the server take more crawling, and does anything link to it?Is it distinct, canonical and actually rendered?
Can resolve on its ownOften, on a small site with a new URLSometimes, when Google revisits
// 02 - status one

What does discovered, currently not indexed mean?

Google has the URL, usually from your sitemap or a link, and hasn't crawled it yet. Search Console prints it as Discovered - currently not indexed, and Google's Page indexing help explains it in one line: "Typically, Google wanted to crawl the URL but this was expected to overload the site; therefore Google rescheduled the crawl." That's also why the last crawl date is empty in the report. It isn't a penalty, it isn't an error, and on a small site with a page published last week it often clears by itself.

So start with the server. Open Crawl stats in Search Console and look at average response time and host status. Slow responses, 5xx errors and timeouts tell Google to crawl less, and that's the documented route into this status. On the small WordPress sites I work on, the other usual suspects are pages nothing meaningful links to, and large sets of near-identical URLs (tags, filters, parameters) that give Google far more addresses than the site has real pages.

It becomes worth investigating when a URL you care about sits there for weeks, or when thousands of URLs do. What it doesn't prove on its own is a crawl budget problem. Google's crawl budget guide is written for very large, fast-changing sites, and it also names sites with a large portion of their URLs in Discovered - currently not indexed as its audience. If that's most of your site, read it. If it's a handful of URLs, Google says keeping the sitemap up to date and checking the Page indexing report is enough, and crawl budget is a hypothesis to test, not a diagnosis to accept.

// 03 - status two

What does crawled, currently not indexed mean?

Google fetched the page, looked at it, and didn't add it to the index at that point. Google's help puts it plainly: it "may or may not be indexed in the future; no need to resubmit this URL for crawling." The word currently is doing real work, because Google may index it later without you touching anything.

This one's about what the page turned out to be. Contributors can include: another URL says the same thing and Google picked that one; the page is one of a set built from the same template with little to separate them; the main content arrives only after JavaScript runs and wasn't there when Google looked, which is the kind of fault JavaScript SEO services exist to find; the page is technically fine but answers nothing a searcher asked; or the site as a whole hasn't yet earned the benefit of the doubt on borderline pages.

It isn't shorthand for thin content, and treating it that way sends people off adding paragraphs to pages whose real problem is that three other URLs already cover the subject.

// 04 - the question nobody asks

Should you fix every URL in these reports?

No, and this is the part most articles skip. Google's own report help says it's fine for a URL not to be indexed for the right reasons, and names a noindex tag, a duplicate URL and an expected robots.txt rule among them. If you're not sure whether a rule in your file is expected, the WordPress robots.txt guide walks through what each line blocks on purpose. The work is deciding which URLs deserve to be in the index at all.

Worth investigating

  • Service, product and location pages that earn enquiries
  • Articles written to answer a real search
  • Category or collection pages people actually land on
  • Anything you'd be annoyed to lose from search

Belongs there, leave it

  • Tag, author and date archives nobody searches for
  • Filtered, faceted and parameter versions of a listing
  • Internal search result pages
  • RSS feed URLs such as /feed/, which aren't pages for searchers
  • Attachment pages and thin auto-generated URLs
  • Deep pagination past the point of usefulness
// 05 - diagnosis

How do you diagnose discovered, currently not indexed?

In order, because each step changes what the next one means. The server check comes second because it's the cause Google names first.

  1. i.

    Decide whether the URL deserves indexing

    If it's an archive, a filter or a duplicate, stop here and handle it with noindex, a canonical or a redirect. Don't spend effort getting it crawled. When Google later reports it as a duplicate with no canonical set, that's the same decision from the other side.

  2. ii.

    Check the server

    Look at Crawl stats for average response time and host status. Slow or failing responses make each fetch expensive, and that's the moment a Google Search Console expert would read the crawl responses before touching anything else.

  3. iii.

    Check what links to it

    Run a crawl with the sitemap connected; crawling a WordPress site with Screaming Frog shows the setup I use. A URL that appears only in the sitemap and nowhere in the site's own links is telling Google it doesn't matter.

  4. iv.

    Check what links to it from other sites

    Google's crawl budget guide says URLs that are more popular on the Internet tend to be crawled more often. A new page with no internal links and no links from anywhere else has the weakest claim on Google's time, so one relevant link from an established page on another site can move it up the queue.

  5. v.

    Check how many similar URLs exist

    Parameters, filters and paginated sets can turn a 200 page site into hundreds of thousands of addresses. Google's crawl budget guide calls duplicate and unimportant URLs a waste of crawling time, and it's the factor you control most.

  6. vi.

    Check how new it is

    A URL published recently on a modest site is often just waiting. Give it weeks before calling it a fault.

// 06 - diagnosis

How do you diagnose crawled, currently not indexed?

Different status, different sequence. The report tells you the pattern; URL Inspection on the specific URL tells you what happened to one page, so don't reason from the report total.

  1. i.

    Read the canonical fields

    URL Inspection shows the user-declared canonical and, in the indexed data, the Google-selected one. If Google picked a different URL, you've got a duplication question, not an indexing one.

  2. ii.

    Check what the rendered page contains

    Use the live test and read the rendered HTML. If the main content only appears after JavaScript and wasn't there, Google judged a near-empty page.

  3. iii.

    Ask what the page is for

    Name the search it answers. If you can't, or if another page on the site answers it better, that's the finding.

  4. iv.

    Compare it with its siblings

    Line up five pages from the same template. If they differ only by a name or a place, the template's the problem, not the individual page.

  5. v.

    Check it isn't orphaned

    A page nothing links to has nothing arguing for it, even once crawled.

// 07 - on wordpress specifically

What causes this on WordPress?

WordPress isn't the problem. What it does is generate URLs enthusiastically, and the default settings publish more of them than most sites need.

i.

Tag and author archives

A site with 400 tags has 400 thin archive URLs in the sitemap. Most sites should noindex tag and author archives and stop submitting them; what to do with WordPress tags and categories walks through the decision.

ii.

Attachment pages

Every uploaded image can get its own URL on older installs. Yoast's media pages setting redirects them to the file itself, and Rank Math's Redirect Attachments option sends them to the post they're used in. Since WordPress 6.4, new installs redirect attachment pages by default.

iii.

WooCommerce filters and parameters

Colour, size, price and sorting combinations multiply. Faceted URLs usually belong out of the sitemap and out of the index.

iv.

Internal search results

/?s= URLs can get linked and crawled. They should never be indexable.

v.

Templated location or service pages

Twenty pages differing only by a place name is the cause of crawled, currently not indexed I find most often on small business sites.

vi.

Sitemap noise

SEO plugins can include archives, attachments and paginated sets. A sitemap should list the URLs you want indexed, not every URL that exists.

// 08 - fixes, grouped by cause

How do you fix discovered or crawled, currently not indexed?

There's no list of ten tricks that gets a page indexed. Match the fix to what the diagnosis found, and fix the pattern (a template, a setting, a plugin option) before any single URL.

If the URL shouldn't be indexed

  • Noindex it, and take it out of the sitemap
  • Canonicalise it to the version that should rank
  • Redirect it if something replaced it
  • Delete it if it serves nobody

If it should be indexed

  • Fix slow or failing server responses first
  • Link to it properly from pages that matter
  • Make sure it's in the right sitemap and returns 200
  • Give it something the similar pages don't have
  • Make the main content present in the rendered HTML
  • Consolidate the near-duplicates competing with it
// 09 - after the fix

How does Validate Fix work for discovered, currently not indexed?

Validate Fix asks Google to recheck the URLs affected by one issue. Google's help says: "Validation typically takes up to about two weeks, but in some cases can take much longer". It works through the known affected URLs only, not the whole site, so a validation that sits at Started for weeks is normal on a big list. Don't click Validate fix again until it has passed or failed.

  1. i.

    Started

    You've begun a validation attempt and no remaining instances of the issue have been found yet.

  2. ii.

    Looking good

    Every affected URL Google has checked so far no longer shows the issue.

  3. iii.

    Passed

    All known instances are gone, or the affected URLs are no longer available. You only reach this state by clicking Validate fix.

  4. iv.

    Failed

    A certain threshold of URLs still has the issue. Open See details to find which URL failed, fix it, then start a new validation.

  5. v.

    N/A

    Google found the issue fixed everywhere without you ever starting a validation.

// 10 - what not to lean on

Does requesting indexing in Search Console fix it?

It's useful for one important URL you've just changed, and it's not a fix. Google's URL Inspection help says submitting a request doesn't guarantee the page will appear in the index, and there's a daily limit on requests. Requesting indexing asks Google to look sooner; it doesn't change what Google concluded, and asking repeatedly doesn't wear it down. If a URL keeps coming back to the same status after a request, the answer's in the diagnosis above, not in the button. The Indexing API isn't a way round it either: Google limits it to pages with JobPosting or BroadcastEvent markup embedded in a VideoObject.

// 11 - timing

How long does it take to fix discovered, currently not indexed?

For a handful of new URLs on an established site, a few weeks is normal and no action's needed. Some URLs in both reports clear with no intervention, which is what currently means in both labels, and others won't (a fair number shouldn't). For an important page that has sat in either report for over a month, diagnose it. For thousands of URLs appearing at once, look for the pattern that produced them, not at any single URL, because the answer's almost always in a template or a setting.

After a real fix, Google has to recrawl before anything changes. Validate the fix in Search Console so you've got a start date, expect Google's two weeks or longer for the validation itself, and give it four to eight weeks before judging the result.

Rather have it fixed for you? See the Crawlability and indexing service.

Crawlability and indexing
// questions

What else do people ask about discovered and crawled, currently not indexed?

Can poor crawl budget cause discovered, currently not indexed?

Not by itself. Google's Page indexing help says that, typically, "Google wanted to crawl the URL but this was expected to overload the site; therefore Google rescheduled the crawl." So check Crawl stats for slow responses and host problems first. On the small WordPress sites I work on, weak internal linking and large sets of near-identical URLs are the other usual suspects.

What does not indexed mean in Search Console?

It means Google knows the URL but it isn't in Google's index, so it can't appear in search results. The Page indexing report lists a reason for each group, such as noindex, duplicate, redirect, or discovered or crawled, currently not indexed. Some of those reasons are exactly what you want; read the reason before fixing anything.

How do I reset Google indexing?

There's no reset button. To get a changed page recrawled, fix it and use Request indexing in URL Inspection. To pull a URL out of results fast, the Removals tool hides it for about six months; making that permanent means a noindex tag, a 404 or 410 status, or putting the page behind a password.

Does crawled, currently not indexed mean my content is thin?

Not necessarily. It can mean another URL already covers the subject, the page is one of many from the same template, the main content didn't render, or Google simply hasn't committed yet. Diagnose the URL before assuming.

Should I remove pages that aren't indexed?

Only if they serve nobody. Archives, filters and parameter URLs are usually best kept out of the index, not deleted, because the site still uses them.

// sources

Where do these rules come from?

Google's own documentation, plus what I see on the WordPress sites I work on. Written by Muhammad Younus, a WordPress technical SEO consultant.

// from the blog

For the statuses that often turn up beside this one, I've written up how I use the URL Inspection tool before pressing Request indexing, fixing Excluded by noindex tag and finding soft 404s. If the whole site's missing rather than a few pages, here's how I work out why a site isn't showing up on Google, and the rest of the posts on indexing and Search Console go status by status.

Muhammad Younus pointing toward the camera with an inviting smile
// next step

Want this checked on your own site?

Book a call on Upwork, share the URL and read-only Search Console access, and you'll get back what's actually wrong, ranked by the clicks it's costing.

Book a call on Upwork