Search
Member List
Calendar
Help
Web Design Forum HTML CSS JavaScript PHP Graphic Design SEO forum
/
Search Engine Marketing
/
Search Engine Optimisation 
/
What is robots.txt?
/
What is robots.txt?
|
What is robots.txt?
|
|
09-27-2017, 05:17 PM
Post: #1
|
|||
|
|||
|
What is robots.txt?
Hlo Friends,
What is robots.txt? Black magic to get my girlfriend back | Black magic tricks|Black magic to hurt someone | Black magic make him love me |
|||
|
|
09-27-2017, 06:06 PM
Post: #2
|
|||
|
|||
|
RE: What is robots.txt?
It's kind of text file containing the instruction for Crawlers to crawl webpage(s), domains, files.
Black magic specialist Voodoo Love Spell Vashikaran |
|||
|
|
|
09-27-2017, 06:13 PM
Post: #3
|
|||
|
|||
|
RE: What is robots.txt?
It is a set of instructions to tell the crawler which areas of the website should not be crawl.
black magic to get your ex back | Muslim Astrologer Black Magic Specialist in Goa | Black Magic Voodoo Spell For Love |
|||
|
|
|
09-27-2017, 08:17 PM
Post: #4
|
|||
|
|||
|
RE: What is robots.txt?
It is a special file which tells the crawler which part of the website should index or not
Muslim Astrologer | Love marriage problem solution | How to get my love back |
|||
|
|
|
09-27-2017, 10:11 PM
Post: #5
|
|||
|
|||
|
RE: What is robots.txt?
I completely agree with you guys.
Vashikaran guru | Muslim Vashikaran |
|||
|
|
|
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 6 Guest(s)