FK FormatKit Tools
Web Tools

Robots.txt Generator

Generate a simple robots.txt file with allow, disallow and sitemap rules.

Robots settings

Robots.txt output

Related tools

Keep the workflow moving

What this tool does

Create a clean starter robots.txt file for a website. Use it to point crawlers toward your sitemap and block private folders.

How to use it well

Start with a small sample, check the output, then paste the full text when the result looks right. For important production data, review the output before saving or sharing it.

Common uses

  • Create starter robots.txt
  • Add sitemap location
  • Block admin or private paths
Guide

Robots.txt Basics for Small Websites

Learn what robots.txt can do, what it cannot protect and why sitemap lines are useful.

Read guide

Questions

Does robots.txt protect private data?

No. It is a crawler instruction, not a security system. Private files must be protected by server rules.

Should I block CSS and JS?

Usually no. Search engines need assets to understand and render pages correctly.