Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website. To learn more and see examples of robots.txt : https://moz.com/learn/seo/robotstxt
Cakephp - MissingControllerException Controller class Robots.txt
Comments