Skip to content
SEO Audit Checker

Page blocked by robots.txt

High priorityOn-page SEO

A Disallow rule in robots.txt stops Googlebot crawling this URL, so Google can’t read its content.

What triggers this issue

  • robots.txt disallows this path for Googlebot (or for all user agents).

Why it matters

Google can’t rank content it isn’t allowed to read. A blocked URL can still appear in results if other sites link to it, but with no description, which looks broken.

Blocking a page in robots.txt also hides any noindex tag on it, because Google never sees the page.

How to fix it

  1. Open yoursite.com/robots.txt and find the Disallow rule matching this path.
  2. Remove or narrow the rule. Test the result with our robots.txt tester.
  3. To keep a page out of results, allow crawling and use noindex instead.
In-depth guideWhy your page isn’t indexed: noindex, nofollow and robots.txt blocks

See all 82 SEO issues →