What is robots.txt?
|
01-23-2018, 10:31 PM
Post: #3
|
|||
|
|||
RE: What is robots.txt?
It gives instructions to web robots about the pages the website owner doesn’t wish to be crawled.
Top Mobile application development Sharjah| iPhone app development company Sharjah |
|||
« Next Oldest | Next Newest »
|
Messages In This Thread |
What is robots.txt? - MoulanaRafi - 01-23-2018, 04:31 PM
RE: What is robots.txt? - online12356 - 01-23-2018, 09:03 PM
RE: What is robots.txt? - andreausa - 01-23-2018 10:31 PM
RE: What is robots.txt? - rishabjoy - 01-24-2018, 05:47 PM
|
User(s) browsing this thread: