+- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au)
+-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18)
+--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8)
+--- Thread: What is robots.txt? (/showthread.php?tid=32254)
What is robots.txt? - loveguru - 04-28-2017 11:13 PM
Hello friends'
can anyone tell me what is robots.txt?
RE: What is robots.txt? - irfanhaider - 05-02-2017 08:02 PM
It contains instructions for robots.
RE: What is robots.txt? - HafijAli - 05-03-2017 10:47 PM
It is primarily used to specify which parts of your website should be crawled by spiders
RE: What is robots.txt? - saketbhai - 05-05-2017 05:44 PM
Robots.txt is a text file webmasters create to instruct web robots