robots.txt Checker | 2lus

Inspect public crawler groups, allow, disallow and sitemap declarations.

What it does

Inspect robots.txt crawler rules. Analyze public-page SEO markup and available site files.

What this tool accepts

text, a URL, or values entered in the tool

What it produces

JSON

How to use it

1. Enter a public page and choose technical, meta or a site-file mode.
2. Run and review evidence for title, description, canonical, OG and robots/sitemap.

Example

Input:
https://example.com

Options:
mode: robots

Output:
Available allow/disallow and sitemap declarations.

Tips and notes

• No ranking or AI citation guarantee; remote JavaScript is not executed.

Privacy and processing

The URL is sent to the 2lus server for a bounded remote inspection. Results are temporary and no browser code from the target is executed.

Open this tool or browse all 2lus tools.