Home / Tools / SEO / Robots.txt Generator

Robots.txt Generator

Build a robots.txt file with allow/disallow rules and sitemap URL.

Allow all (with optional Disallow paths)

Disallow paths (one per line)

Sitemap URL

Crawl-delay (optional)

robots.txt

User-agent: *
Disallow: /admin
Disallow: /api
Allow: /
Sitemap: https://example.com/sitemap.xml

How it works

Where do I put robots.txt?

At your site root: https://example.com/robots.txt

Sitemap Generator

Generate a basic XML sitemap from a list of URLs.

SEO

Meta Tag Generator

Generate title, description, and social meta tags for your pages.

SEO

Slug Generator

Convert titles into clean URL slugs.

SEO

Open Graph Generator

Generate Open Graph tags for social link previews.

SEO

Need a smarter recommendation?

Ask Ebenezer AI, or compare software on our tools directory.