Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum / Search Engine Marketing / Search Engine Optimisation v / What is robots.txt?

Post Reply 
 
Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
What is robots.txt?
09-27-2017, 06:13 PM
Post: #3
MoulanaRafi Offline
Senior Member
****
 		Posts: 600
Joined: May 2016
Reputation: 0
RE: What is robots.txt?
It is a set of instructions to tell the crawler which areas of the website should not be crawl.
black magic to get your ex back | Muslim Astrologer
Black Magic Specialist in Goa | Black Magic Voodoo Spell For Love
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
What is robots.txt? - panditmannat - 09-27-2017, 05:17 PM
RE: What is robots.txt? - saketbhai - 09-27-2017, 06:06 PM
RE: What is robots.txt? - MoulanaRafi - 09-27-2017 06:13 PM
RE: What is robots.txt? - HafijAli - 09-27-2017, 08:17 PM
RE: What is robots.txt? - DevinMarshal - 09-27-2017, 10:11 PM

Forum Jump:


User(s) browsing this thread: 1 Guest(s)

Contact Us | Web Design Forum | Return to Top | Return to Content | Lite (Archive) Mode | RSS Syndication