Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum / Search Engine Marketing / Search Engine Optimisation v / What is the use of robots.txt?

Post Reply 
 
Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
What is the use of robots.txt?
09-23-2016, 10:43 PM
Post: #1
artijain1900 Offline
Member
***
 		Posts: 84
Joined: Mar 2016
Reputation: 0
What is the use of robots.txt?
Hello Guys,


I would like to know that What is the use of robots.txt? tell me ..
Free astrology consultancy services | Free online Vedic astrology in hindi | Free astrology on phone | online horoscope astrology reading
Visit this user's website Find all posts by this user
Quote this message in a reply
09-26-2016, 10:01 PM
Post: #2
GeorgeLucas Offline
Junior Member
**
 		Posts: 41
Joined: Jul 2016
Reputation: 0
RE: What is the use of robots.txt?
Prevention of crawling the confidential information like credit card, email, phone number.
Mobile Application Development Madrid | Mobile Application Development Istanbul
Visit this user's website Find all posts by this user
Quote this message in a reply
10-07-2016, 04:49 PM
Post: #3
MamtaSharma Offline
Member
***
 		Posts: 55
Joined: Apr 2016
Reputation: 0
RE: What is the use of robots.txt?
Is a text file webmasters create to instruct robots how to crawl & index pages on their website.
Electrical Panel Manufacturers | DG Synchronization Panel Manufacturers
Visit this user's website Find all posts by this user
Quote this message in a reply
10-11-2016, 09:36 PM
Post: #4
DevinMarshal Offline
Senior Member
****
 		Posts: 261
Joined: Aug 2016
Reputation: 0
RE: What is the use of robots.txt?
It is file that will help in crawling.
Vashikaran guru | Muslim Vashikaran
Visit this user's website Find all posts by this user
Quote this message in a reply
10-12-2016, 09:22 PM
Post: #5
SultanMirza Offline
Member
***
 		Posts: 163
Joined: Aug 2016
Reputation: 0
RE: What is the use of robots.txt?
It will use to instruct crawler how to crawl & index pages on their website.
Black magic specialist in Pune Love problem solution in Mumbai | Black Magic Specialist in Australia
Find all posts by this user
Quote this message in a reply
10-12-2016, 10:07 PM
Post: #6
DenialClark Offline
Member
***
 		Posts: 131
Joined: Sep 2016
Reputation: 0
RE: What is the use of robots.txt?
Robots file use to instruct crawler.
Black Magic Specialist | Love Marriage Solution
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump:


User(s) browsing this thread: 1 Guest(s)

Contact Us | Web Design Forum | Return to Top | Return to Content | Lite (Archive) Mode | RSS Syndication