Crawled – currently not indexed: what it means and how to fix it

Equipe NotHuman

Written with AI, reviewed by humans.

Reading time: 10 minutes

Crawled – currently not indexed is the Search Console status for a page that Google visited and chose to leave out of its index. According to the official help, the page may or may not be indexed later, and there is no need to resubmit it. So we recommend improving or consolidating the page instead of repeating the request.

In short

  • The status means Googlebot already read the page, but Google did not add it to the index. Discovered – currently not indexed, on the other hand, means Google has not even crawled the URL yet.
  • According to Google, not every crawled page goes into the index, because Google evaluates, consolidates and assesses each one first.
  • Requesting indexing many times won’t speed up crawling, according to Google. Also, a request doesn’t guarantee that the page gets indexed.
  • Our recommendation: after you change the page, wait at least two weeks before you draw conclusions. That is the time Google gives for indexing requests and for validation.

What does “Crawled – currently not indexed” mean?

It means Google crawled the page but did not include it in the index. The Page indexing report help says the page may or may not be indexed in the future. It also says there is no need to resubmit the URL. In other words, Google had access to the content and, for now, chose not to store it.

The status shows up in two places. The Page indexing report lists it in the “Why pages aren’t indexed” table. In the URL Inspection tool, however, it appears as the reason a specific URL is not on Google. For Brazilian Portuguese users, the help and the interface use slightly different names for it, but the English name is the same in both.

The key point is in the guide to how Search works. According to Google, indexing isn’t guaranteed, and not every page it processes gets indexed. Indexing also depends on the content of the page and its metadata. Among the common issues, the guide lists low-quality content. So a page that is crawled but not indexed got past the crawler and stopped at the next stage.

When is the status not a problem?

When the page doesn’t need to be in Search. The help says that Not indexed is not necessarily bad. In addition, Google doesn’t index duplicate pages or variations of a page with different filters applied. For example, a URL with a sort parameter can stay out with no harm.

That’s why you should start with the list of examples in the report and split the URLs into two groups. The first group holds the pages that need to show up, such as services, products and articles. The second holds the ones that can stay out. Only the first group needs action.

Crawled currently not indexed: illustration of a small robot following a trail to an open filing cabinet, with a page left outside and a pause icon

What is the difference between crawled and discovered, but not indexed?

The difference is crawling. With a page that is crawled but not indexed, Googlebot already read the content, and the decision was not to index it. With Discovered – currently not indexed, Google knows the URL but has not crawled it yet.

According to the report help, Discovered – currently not indexed typically happens when Google wanted to crawl the URL, but this was expected to overload the site. So Google rescheduled the crawl, and the last crawl date is empty in the report.

StatusWhat Google didWhere to look
Crawled – currently not indexedRead the page and didn’t index itContent, copies and canonical
Discovered – currently not indexedFound the URL and didn’t crawl itServer, number of URLs and links

With Discovered, therefore, the problem tends to be crawling. Google’s crawl budget guide names sites with a large share of URLs in that status among the sites it is for. The same guide says that slow responses, 5xx errors and HTTP 429 make Google crawl less. Duplicate URLs, in turn, waste crawling time.

With Crawled – currently not indexed, however, the server responded and Google read the page. So the search for the cause moves to the content and to the choice of canonical. Our technical SEO audit covers server, log and crawl tests, in case the site has both statuses at once.

Does duplicate or thin content cause the crawled currently not indexed status?

It might, but the report doesn’t say why each URL is out. What the URL Inspection help does is list conditions for indexing a page. The page can’t be a duplicate of another indexed page, and its quality must be high enough. So, in our reading, duplication and thin content are the first suspects, not proven causes.

In the URL Inspection tool help, Google explains that a valid live test doesn’t guarantee indexing. The page must be unique, or selected as the canonical version of a set of similar pages. Also, it can’t be subject to manual actions or legal issues.

How does Google handle similar pages?

Google groups similar pages and picks one as the canonical. According to the canonicalization documentation, the rel=”canonical” tag, redirects and sitemaps work as a hint, not a rule. In other words, Google may pick a different page.

In practice, posts on the same topic with nearly identical text compete for the same spot. Likewise, city pages with the same text and only the city name swapped tend to look like copies. In these cases, we recommend merging the content into one more complete page, instead of requesting indexing for all of them.

What if the content is thin?

Then the question is whether the page adds anything. Google publishes a guide on helpful, reliable content with self-assessment questions. One asks if content that draws on other sources avoids simply copying or rewriting them, and adds value and originality.

Another question asks if the content provides substantial value compared to other pages in search results. So a service page with three generic sentences is a good candidate for improvement. The same goes for a post that sums up what ten other sites already say. It’s also worth checking what Google sees. On JavaScript sites, the text may not show up for the crawler, and the test is in our guide to JavaScript SEO for AI crawlers.

Does requesting indexing fix it?

Usually not, if the page hasn’t changed. Google says there is no need to resubmit the URL with this status. In addition, the page on asking Google to recrawl warns that requesting a recrawl many times for the same URL won’t get it crawled faster. A request only makes sense after a real change to the page.

The same Google page says that a crawl request doesn’t guarantee inclusion in search results. According to the page, Google’s systems prioritize the fast inclusion of high-quality, useful content. Also, there is a quota for submitting individual URLs.

Therefore, if a service page is still crawled but not indexed after many requests, we take that as Google’s answer. Instead of insisting, change the page and only then make one request. For many URLs, the URL Inspection help points to a sitemap instead.

How to fix a page that is crawled but not indexed

To get a page out of the crawled currently not indexed status, first inspect a few example URLs and make sure nothing technical is in the way. Next, check whether Google picked a different canonical. Then improve or merge the content and add internal links. Finally, request indexing once and keep an eye on it. This is the order we recommend, based on Google’s documentation:

  1. Inspect the URL: in the URL Inspection tool, click Test live URL and then View tested page. Check the screenshot to see if the main content shows up.
  2. Check the canonical: under Page indexing, compare the User-declared canonical with the Google-selected canonical.
  3. Decide what to do: if the page doesn’t need to be in Search, leave it as it is. If it repeats another page, redirect it or merge the two.
  4. Improve the content: add what only your company knows, such as prices, processes, examples and your own data.
  5. Connect the page to the site: link to the URL from important pages and keep it in the sitemap.
  6. Request indexing once: use Request indexing in the URL Inspection tool only after the change.

If the report has many URLs with this status, the report help lets you click Validate fix on the details page for each reason. As a tip, Google suggests submitting a sitemap with only your most important pages. Then filter the report by that sitemap before you validate. That way, validation can finish faster.

What if half the blog has this status?

In that case, the pattern matters more than each URL. First, see if the pages outside the index have something in common. It could be the same template, short posts on repeated topics or tag and category pages with little text. Next, merge the posts that cover the same subject and improve the ones that bring traffic or sales. For a view of SEO for the whole site, see our guide to SEO and AI.

How long should you wait before acting?

Google gives no timeline for the crawled currently not indexed status itself, but it does give timelines for the steps around it. According to the URL Inspection help, an indexing request typically takes only a day or so. However, it can take up to a week or two. That’s why we recommend waiting at least two weeks after you change the page before you conclude nothing changed.

The other timelines come from different Google pages:

  • Recrawl: anywhere from a few days to a few weeks, according to the page on asking Google to recrawl.
  • Fix validation: typically up to about two weeks, but it can take much longer, according to the report help.
  • New page: after Google knows the URL, crawling can take some time, up to a few weeks.

On the other hand, a page not indexed right after it goes live doesn’t always need action. The help itself says indexing is never instant. Site size also matters. According to Google, sites with fewer than 500 pages probably don’t even need the Page indexing report. For them, checking the key pages is enough.

What does the status change for Google’s AI answers?

It changes everything, because a page outside the index can’t be a source. The rule is on the AI features and your website page. To be a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to show with a snippet. So a page not indexed stays out of those answers.

On the same page, Google also says there are no additional technical requirements for these features. In other words, fixing the crawled currently not indexed status is the first step for the page to appear in Google’s AI answers. Our guide to Google AI Mode and AI Overviews explains how these features choose their sources after indexing.

Want to know how your brand shows up in AI answers today?

NotHuman is opening spots for agencies and brands to track how they appear in AI answers. Join the waitlist and we’ll let you know when a spot opens up for you.

Main sources

Contents

Keep reading

Get new NotHuman articles by email

One email when we publish a new article about GEO, SEO and AI. You can unsubscribe at any time.