Blogger already serves a robots.txt for your blog, and its custom robots.txt setting lets you replace that with your own text. Build the file above with the paths you want crawlers to skip and your sitemap URL. Then paste it into Settings under Crawlers and indexing, and search engines get your version instead of Blogger's default.
Add the file to Blogger
- Start from Allow all, leave the user-agent as * to cover every crawler, and add each path you want skipped on its own Disallow line.
- Put in your sitemap URL, then copy the finished file.
- In Blogger, open Settings and scroll to Crawlers and indexing.
- Turn on Enable custom robots.txt, open the custom robots.txt box, paste the file and save.
Blogger uses your text in place of the default file, not alongside it. Paste the whole file every time, including the lines you didn't change.
What Google reads in the file
- Paths start with / and are case sensitive, so /Search and /search are two different paths.
- The sitemap line needs the full URL, with https:// and your blog's address.
- Google doesn't support crawl delay. Leave that box empty if Google is the crawler you care about.
- Google reads up to 500 KiB of a robots.txt file. A blog's file will be a few lines long.
From Blogger Help and Google Search Central's robots.txt documentation, read in October 2026.
The generator doesn't read your blog or check that the paths you type exist. It also doesn't set robots header tags. Blogger keeps those under a separate setting, Enable custom robots header tags, in the same Crawlers and indexing section.
This robots.txt generator is free with no signup. SearchBlueprint, who make it, sell SEO planning for websites: which searches each page should answer.