+- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au)
+-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18)
+--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8)
+--- Thread: What is the use of robots.txt? (/showthread.php?tid=31756)
What is the use of robots.txt? - artijain1900 - 09-23-2016 10:43 PM
Hello Guys,
I would like to know that What is the use of robots.txt? tell me ..
RE: What is the use of robots.txt? - GeorgeLucas - 09-26-2016 10:01 PM
Prevention of crawling the confidential information like credit card, email, phone number.
RE: What is the use of robots.txt? - MamtaSharma - 10-07-2016 04:49 PM
Is a text file webmasters create to instruct robots how to crawl & index pages on their website.
RE: What is the use of robots.txt? - DevinMarshal - 10-11-2016 09:36 PM
It is file that will help in crawling.
RE: What is the use of robots.txt? - SultanMirza - 10-12-2016 09:22 PM
It will use to instruct crawler how to crawl & index pages on their website.
RE: What is the use of robots.txt? - DenialClark - 10-12-2016 10:07 PM
Robots file use to instruct crawler.