search
Innovative Web Design and Application Development
PawPrint.net

PawPrint.net Glossary of Terms

Main Menu -> Web Design -> robots.txt

robots.txt

A text file stored in the top level directory of a web site which is used to tell the Robots (spiders) what parts of a web site should, and should not be indexed.


Copyright © 1992-2019 PawPrint.net
web development: PawPrint.net