Robots.txt Validator

Validate your robots.txt file.

1. Source

2. Test Rule

e.g., Googlebot, Bingbot, *

Matched Rule:
No explicit disallow rule found (Implicit Allow)

Features

  • Validate URLs against robots.txt rules.
  • Support Fetching robots.txt directly from a URL or pasting content.
  • Simulate different User-Agents.
  • Identify which rule blocks or allows a path.

How to Use

  1. Provide the robots.txt content by URL or direct input.
  2. Enter the path you want to test (e.g. /private/page).
  3. Enter the User-Agent you want to simulate.
  4. Click "Test" to see if the bot would be allowed or disallowed.