robots.txt is a file with web server access restrictions for search engines.It should be located only in the root directory of the site, and contain only lowercase letters, that is, “robots.t…