Robots.txt Generator – Free Robots File Maker

Free robots.txt generator. Build a robots.txt file with allow and disallow rules, a sitemap and crawl-delay, using presets for WordPress, Blogger and Wix.

Start from a preset:
Crawl rules (one rule per line: which crawlers it applies to, allow or disallow, and the path) 

                
Save the downloaded file as robots.txt in the root folder of your website. Everything is generated in your browser; nothing is uploaded.

            

        

                

        

    

        
Share on Social Media:

    

    






        
Robots.txt Generator
Use this free robots.txt generator to build a robots.txt file for your website. Add allow and disallow rules for any crawler, add your sitemap URL and a crawl-delay, then copy the file or download it as robots.txt. The tool includes presets for WordPress, Blogger, Wix and basic SEO, and an example robots txt file you can start from. If you want to know how to create robot txt file for your site, this tool builds it for you in a few clicks.
What is this tool?
A robots.txt file tells search engine crawlers which parts of a website they may visit. It is a plain text file that sits in the root folder of a website and uses User-agent, Allow and Disallow lines. This free generator builds the file in your browser, so nothing you enter is uploaded.
How to use the Robots.txt Generator
  1. Start from a preset, such as WordPress, Blogger, Wix or Basic SEO, or start with a blank set of rules.
  2. Add a rule for each path: choose the user-agent it applies to, choose Allow or Disallow, and enter the path, for example /wp-admin/.
  3. Add your sitemap URL, a crawl-delay in seconds, and a host if you need one.
  4. Press Generate robots.txt, then copy the result or download it as robots.txt and upload it to the root folder of your website.
Why use this free tool?
  • Presets for WordPress, Blogger, Wix and basic SEO, plus allow all and block all options.
  • Unlimited allow and disallow rules for any user-agent, including the * wildcard.
  • Sitemap, crawl-delay and host lines included in the output.
  • One-click copy and a direct robots.txt download, with no account needed.
  • Free to use, with everything processed in your browser.
Alternative keywords
People also search for this tool as a robots txt generator free, an example robots txt file, how to create robot txt file, a robots.txt maker, and a robots.txt file generator for WordPress.
Common problems this tool helps fix
  • Not knowing the correct format for a robots.txt file.
  • Blocking search engines from admin and login pages by mistake, or not blocking them at all.
  • Forgetting to list the sitemap in robots.txt.
  • Needing a quick robots.txt file for a new website.
Helpful tip
A simple example robots txt file for WordPress looks like this: User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-login.php
Disallow: /wp-includes/
Sitemap: https://example.com/sitemap.xml
Load the WordPress preset in the tool to start from this example, then change the rules to fit your site.





        

            

                
Frequently Asked Questions

                                
Common questions about the Robots.txt Generator – Free Robots File Maker — quick answers below.

            

            

                

                                            

                            

                                
                            

                            

                                
A robots.txt file is a plain text file that tells search engine crawlers which parts of a website they may visit. It sits in the root folder of a website and uses User-agent, Allow and Disallow lines.

                            

                        

                                            

                            

                                
                            

                            

                                
Choose a preset or add your own allow and disallow rules, add your sitemap URL if you have one, then press Generate robots.txt. Copy the result or download it as robots.txt and upload it to the root folder of your website.

                            

                        

                                            

                            

                                
                            

                            

                                
A basic WordPress robots.txt blocks the admin area and the login page, allows admin-ajax.php so the site still works, and lists the sitemap. You can load this example with the WordPress preset in the tool.

                            

                        

                                            

                            

                                
                            

                            

                                
Yes. The robots.txt generator is free to use with no account. Your file is created in your browser and nothing you enter is uploaded.