Edit robots.txt

Robots.txt tells search engines (robots) which URLs on your site they can access.

Where you can find your site's robots.txt file

The robots.txt file lives in your site's webroot (root directory) and is accessible at yourdomain.com/robots.txt.

If there is no robots.txt file in the webroot, WordPress generates one "on the fly" when someone visits the URL.

How to edit the content of robots.txt

To edit the file, follow our guide on how to set up file access, navigate to your site's webroot, and edit the robots.txt file there.

If the file doesn't exist (WordPress is generating it on the fly), simply upload your own robots.txt file to the webroot to take control of its content.