Your web pages can go into one of the following four buckets:<\/p>\n
- \n
- Error<\/strong>: The pages that Google cannot index. You should review this report because Google thinks you may want these pages indexed.<\/li>\n
- Valid with warnings<\/strong>: The pages that Google indexes, but there are some issues you should resolve.<\/li>\n
- Valid<\/strong>: The pages that Google indexes.<\/li>\n
- Excluded<\/strong>: The pages that are excluded from the index.<\/li>\n<\/ul>\n
![\"Google](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna.jpg\")
<\/p>\n<\/p>\nWhat Are Excluded Pages?<\/h2>\n
Google does not index pages in the Error and Excluded buckets.<\/p>\n
The main difference between the two is:<\/p>\n
- \n
- Google thinks pages in Error should be indexed but cannot because of an error you should review.<\/strong> For example, non-indexable pages submitted through an XML sitemap fall under Error.<\/li>\n
- Google thinks pages in the Excluded bucket should indeed be excluded, and this is your intention.<\/strong> For example, non-indexable pages not submitted to Google will appear in the Excluded report.\n
![\"Excluded](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-1.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\n<\/li>\n<\/ul>\nHowever, Google doesn\u2019t always get it right and pages that should be indexed sometimes go to Excluded.<\/p>\n
Fortunately, Google Search Console<\/a> provides the reason for placing pages in a specific bucket.<\/p>\n
This is why it\u2019s a good practice to carefully review the pages in all four buckets.<\/p>\n
Let\u2019s now dive into the Excluded bucket.<\/p>\n
Possible Reasons For Excluded Pages<\/h3>\n
There are 15 possible reasons your web pages are in the Excluded group. Let\u2019s take a closer look at each one.<\/p>\n
Excluded by \u201cnoindex\u201d tag<\/strong><\/p>\n
These are the URLs that have a \u201cnoindex\u201d tag.<\/p>\n
Google thinks you actually want to exclude these pages from indexation because you don\u2019t list them in the XML sitemap<\/a>.<\/p>\n
These may be, for example, login pages, user pages, or search result pages.<\/p>\n
![\"Google](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-2.jpg\")
<\/p>\n<\/p>\nSuggested actions:<\/p>\n
- \n
- Review these URLs<\/strong> to be sure you <\/strong>want to exclude them from Google\u2019s index.<\/li>\n
- Check if a \u201cnoindex\u201d tag is still\/actually present<\/strong> on those URLs.<\/li>\n<\/ul>\n
Crawled \u2013 Currently Not Indexed <\/strong><\/p>\n
Google has crawled these pages and still has not indexed them.<\/p>\n
As Google says in its documentation<\/a>, the URL in this bucket \u201cmay or may not be indexed in the future; no need to resubmit this URL for crawling.\u201d<\/p>\n
Many SEO pros noticed that a site might have some serious quality issues if many normal and indexable pages go under Crawled \u2013 currently not indexed.<\/p>\n
This could mean Google has crawled these pages and does not think they provide enough value to index.<\/p>\n
![\"Google](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-3.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nSuggested actions:<\/p>\n
- \n
- Review your website in terms of quality<\/strong> and E-A-T<\/a>.<\/li>\n<\/ul>\n
Discovered \u2013 Currently Not Indexed <\/strong><\/p>\n
As Google documentation says, the page under Discovered \u2013 currently not indexed \u201cwas found by Google, but not crawled yet.\u201d<\/p>\n
Google did not crawl the page not to overload the server. A huge number of pages under this bucket may mean your site has crawl budget<\/a> issues.<\/p>\n
![\"Google](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-4.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nSuggested actions:<\/p>\n
- \n
- Check the health of your server<\/strong>.<\/li>\n<\/ul>\n
Not Found (404)<\/strong><\/p>\n
These are the pages that returned status code 404 (Not Found) when requested by Google.<\/p>\n
These are not URLs submitted to Google (i.e., in an XML sitemap<\/a>), but instead, Google discovered these pages (i.e., through another website that linked to an old page deleted a long time ago.<\/p>\n
![\"Excluded](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-5.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nSuggested actions:<\/p>\n
- \n
- Review these pages and decide whether to implement a 301 redirect to a working page<\/strong>.<\/li>\n<\/ul>\n
Soft 404<\/strong><\/p>\n
Soft 404<\/a>, in most cases, is an error page that returns status code OK (200).<\/p>\n
Alternatively, it can also be a thin page that contains little to no content and uses words like \u201csorry,\u201d \u201cerror,\u201d \u201cnot found,\u201d etc.<\/p>\n
![\"Soft](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-6.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nSuggested actions:<\/p>\n
- \n
- In the case of an error page, make sure to return status code 404<\/strong>.<\/li>\n
- For thin content pages,<\/strong> add unique content<\/strong> to help Google recognize this URL as a standalone page.<\/li>\n<\/ul>\n
Page With Redirect<\/strong><\/p>\n
All redirected pages on your website will go to the Excluded bucket, where you can see all redirected pages that Google detected on your website.<\/p>\n
![\"Page](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-7.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nSuggested actions:<\/p>\n
- \n
- Review the redirected pages<\/strong> to make sure the redirects were implemented intentionally.<\/li>\n
- Some WordPress plugins automatically create redirects<\/strong> when you change the URL, so you may want to review these occasionally.<\/li>\n<\/ul>\n
Duplicate Without User-Selected Canonical<\/strong><\/p>\n
Google thinks these URLs are duplicates of other URLs on your website and, therefore, should not be indexed.<\/p>\n
You did not set a canonical tag for these URLs, and Google selected the canonical based on other signals.<\/p>\n
Suggested actions:<\/p>\n
- \n
- Inspect these URLs to check what canonical URLs<\/strong> Google has selected for these pages.<\/li>\n<\/ul>\n
Duplicate, Google Chose Different Canonical Than User<\/strong><\/p>\n
![\"Excluded](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-8.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nIn this case, you declared a canonical URL<\/a> for the page, but even so, Google selected a different URL as the canonical. As a result, the Google-selected canonical is indexed, and the user-selected one is not.<\/p>\n
Possible actions:<\/p>\n
- \n
- Inspect the URL to check what canonical<\/strong> Google selected.<\/li>\n
- Analyze possible signals that made Google choose<\/strong> a different canonical (i.e., external links).<\/li>\n<\/ul>\n
Duplicate, Submitted URL Not Selected As Canonical<\/strong><\/p>\n
The difference between the above status and this status is that in the case of the latter, you submitted a URL to Google for indexation without declaring its canonical address, and Google thinks a different URL would make a better canonical.<\/p>\n
As a result, the Google-selected canonical is indexed rather than the submitted URL.<\/p>\n
Suggested actions:<\/p>\n
- \n
- Inspect the URL to check what canonical<\/strong> Google has selected.<\/li>\n<\/ul>\n
Alternate Page With Proper Canonical Tag<\/strong><\/p>\n
These are simply the duplicates of the pages that Google recognizes as canonical URLs.<\/p>\n
These pages have the canonical addresses that point to the correct canonical URL.<\/p>\n
Suggested actions:<\/p>\n
- \n
- In most cases, no action is required<\/strong>.<\/li>\n<\/ul>\n
Blocked By Robots.txt <\/strong><\/p>\n
These are the pages that robots.txt<\/a> have blocked.<\/p>\n
When analyzing this bucket, keep in mind that Google can still index these pages (and display them in an \u201cimpaired\u201d way) if Google finds a reference to them on, for example, other websites.<\/p>\n
Suggested actions:<\/p>\n
- \n
- Verify if these pages are blocked<\/strong> using the robots.txt tester.<\/li>\n
- Add a \u201cnoindex\u201d tag and remove the pages from robots.txt<\/strong> if you want to remove them from the index.<\/li>\n<\/ul>\n
Blocked By Page Removal Tool <\/strong><\/p>\n
This report lists the pages whose removal has been requested by the Removals tool<\/a>.<\/p>\n
Keep in mind that this tool removes the pages from search results only temporarily (90 days) and does not remove them from the index.<\/p>\n
Suggested actions:<\/p>\n
- \n
- Verify if the pages submitted via the Removals tool<\/strong> should be temporarily removed or have a \u2018noindex\u2019 tag.<\/li>\n<\/ul>\n
Blocked Due To Unauthorized Request (401)<\/h4>\n
In the case of these URLs, Googlebot was not able to access the pages because of an authorization request (401 status code).<\/p>\n
Unless these pages should be available without authorization, you don\u2019t need to do anything.<\/p>\n
Google is simply informing you about what it encountered.<\/p>\n
![\"401](\"https:\/\/marketingnewsbox.com\/wp-content\/uploads\/2022\/06\/fixing-google-search-consoles-coverage-report-excluded-pages-via-sejournal-olgazarzeczna-9.jpg\")
Screenshot from Google Search Console, May 2022<\/em><\/span><\/div>\nSuggested actions:<\/p>\n
- \n
- Verify if these pages should actually require authorization<\/strong>.<\/li>\n<\/ul>\n
Blocked Due To Access Forbidden (403)<\/h4>\n
This status code<\/a> is usually the result of some server error.<\/p>\n
403 is returned when credentials provided are not correct, and access to the page could not be granted.<\/p>\n
As Google documentation<\/a> states:<\/p>\n
\n
\u201cGooglebot never provides credentials, so your server is returning this error incorrectly. This error should either be fixed, or the page should be blocked by robots.txt or noindex.\u201d<\/p>\n<\/blockquote>\n
What Can You Learn From Excluded pages?<\/h3>\n
Sudden and huge spikes in a specific bucket of Excluded pages may indicate serious site issues.<\/p>\n
Here are three examples of spikes that may indicate severe problems with your website:<\/p>\n
- \n
- A huge spike in Not Found (404) pages may indicate unsuccessful migration<\/a><\/strong> where URLs have been changed, but redirects to new addresses have not been implemented. This may also happen after, for example, an inexperienced person changed the slug of blog posts and as a result, changed the URLs of all blogs.<\/li>\n
- A huge spike in the Discovered \u2013 currently not indexed<\/a> or Crawled<\/strong> \u2013 currently not indexed may indicate that your site has been hacked.<\/strong> Make sure to review the example pages to check if these are actually your pages or were created as a result of a hack (i.e., pages with Chinese characters).<\/li>\n
- A huge spike in Excluded by \u2018noindex\u2019 tag may also indicate unsuccessful launch and migration<\/strong>. This often happens when a new site goes to production together with \u201cnoindex\u201d tags from the staging site.<\/li>\n<\/ul>\n
The Recap<\/h3>\n
You can learn a lot about your website and how Googlebot interacts with it, thanks to the Excluded section of the GSC Coverage report.<\/p>\n
- A huge spike in the Discovered \u2013 currently not indexed<\/a> or Crawled<\/strong> \u2013 currently not indexed may indicate that your site has been hacked.<\/strong> Make sure to review the example pages to check if these are actually your pages or were created as a result of a hack (i.e., pages with Chinese characters).<\/li>\n
- A huge spike in Not Found (404) pages may indicate unsuccessful migration<\/a><\/strong> where URLs have been changed, but redirects to new addresses have not been implemented. This may also happen after, for example, an inexperienced person changed the slug of blog posts and as a result, changed the URLs of all blogs.<\/li>\n
- Verify if these pages should actually require authorization<\/strong>.<\/li>\n<\/ul>\n
- Add a \u201cnoindex\u201d tag and remove the pages from robots.txt<\/strong> if you want to remove them from the index.<\/li>\n<\/ul>\n
- Verify if these pages are blocked<\/strong> using the robots.txt tester.<\/li>\n
- In most cases, no action is required<\/strong>.<\/li>\n<\/ul>\n
- Analyze possible signals that made Google choose<\/strong> a different canonical (i.e., external links).<\/li>\n<\/ul>\n
- Inspect the URL to check what canonical<\/strong> Google selected.<\/li>\n
- Some WordPress plugins automatically create redirects<\/strong> when you change the URL, so you may want to review these occasionally.<\/li>\n<\/ul>\n
- For thin content pages,<\/strong> add unique content<\/strong> to help Google recognize this URL as a standalone page.<\/li>\n<\/ul>\n
- In the case of an error page, make sure to return status code 404<\/strong>.<\/li>\n
- Review these pages and decide whether to implement a 301 redirect to a working page<\/strong>.<\/li>\n<\/ul>\n
- Check the health of your server<\/strong>.<\/li>\n<\/ul>\n
- Check if a \u201cnoindex\u201d tag is still\/actually present<\/strong> on those URLs.<\/li>\n<\/ul>\n
- Google thinks pages in the Excluded bucket should indeed be excluded, and this is your intention.<\/strong> For example, non-indexable pages not submitted to Google will appear in the Excluded report.\n
- Valid with warnings<\/strong>: The pages that Google indexes, but there are some issues you should resolve.<\/li>\n