Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum
Is the robots.txt file necessary for seo? - Printable Version

+- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au)
+-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18)
+--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8)
+--- Thread: Is the robots.txt file necessary for seo? (/showthread.php?tid=412)



Is the robots.txt file necessary for seo? - letthemusic - 09-12-2011 07:26 PM

hi,

i know that in the robots.txt file i can tell google what pages on my site not to crawl.

are there any other uses of this file?

can it be useful for seo in any way?

i dont think theres any pages on my site that i dont want search engines to crawl so im thinking i might not need this file unless there are other reasons for it


thanks.


RE: Is the robots.txt file necessary for seo? - eswari - 09-13-2011 12:15 AM

I don't think so its more necessary..