Is the robots.txt file necessary for seo? - Printable Version +- Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum (http://www.webdesignforum.com.au) +-- Forum: Search Engine Marketing (/forumdisplay.php?fid=18) +--- Forum: Search Engine Optimisation (/forumdisplay.php?fid=8) +--- Thread: Is the robots.txt file necessary for seo? (/showthread.php?tid=412) |
Is the robots.txt file necessary for seo? - letthemusic - 09-12-2011 07:26 PM hi, i know that in the robots.txt file i can tell google what pages on my site not to crawl. are there any other uses of this file? can it be useful for seo in any way? i dont think theres any pages on my site that i dont want search engines to crawl so im thinking i might not need this file unless there are other reasons for it thanks. RE: Is the robots.txt file necessary for seo? - eswari - 09-13-2011 12:15 AM I don't think so its more necessary.. |