Hi all – I do not want any search engines crawling my website while I am working on the design so I have just uploaded a robots.txt file to my server in the root directory with the following code;
User-agent: *
Disallow: /
I check it’s there and all is ok – but when I enter https://www.mysite.com/robots.txt in the browser I get the error:
Forbidden
You don’t have permission to access /robots.txt on this server.
So what is the solution to this problem? I am now going to dig about and come back to this page when I have the solution to how to fix the page error; Forbidden You don’t have permission to access /robots.txt on this server.
Update: how to remove and fix issue with forbidden access to robots.txt file
Right here is the answers I could find relating to this access issue;
