+- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au)
+-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18)
+--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8)
+--- Thread: What is robots.txt? (/showthread.php?tid=32098)
What is robots.txt? - HafijAli - 03-20-2017 05:37 PM
Hlo Friends,
Can anyone tell me, What is robots.txt?
RE: What is robots.txt? - saketbhai - 03-20-2017 05:49 PM
it gives instruction to search engine crawlers about indexing and caching of a webpage.
RE: What is robots.txt? - kumarvinod - 03-21-2017 02:35 PM
It is a text file webmasters create to instruct robots how to crawl & index pages on their website.