Robots Meta Tag
By Jerry West
The Robots Meta Tag allows HTML authors to indicate to visiting robots if a document may be indexed or used to harvest more links. No server administator action is required.
There are only a handful of search engine robots which read the robots.txt file.
Proper usage to index a page and follow all links:
<META NAME="ROBOTS" CONTENT="INDEX, FOLLOW">
Proper usage to index a page but not follow all links:
<META NAME="ROBOTS" CONTENT="INDEX, NO FOLLOW">
Proper usage to exclude a page from being indexed, but have the links followed:
<META NAME="ROBOTS" CONTENT="NO INDEX, FOLLOW">
Proper usage to exclude a page from being indexed or links followed:
<META NAME="ROBOTS" CONTENT="NO INDEX, NO FOLLOW">
The robots meta tag is NOT case sensitive.
© 2000, WebMarketingNow.com
Jerry West is the Director of Internet Marketing for WebMarketingNow. He has been consulting on the web since 1996 and has assisted hundreds of companies gain an upper-hand over their competition. Visit http://www.webmarketingnow.com/ for the latest in marketing tips that are tested and proven.
| DISCLAIMER: The content provided in this article is not warranted or guaranteed by Developer Shed, Inc. The content provided is intended for entertainment and/or educational purposes in order to introduce to the reader key ideas, concepts, and/or product reviews. As such it is incumbent upon the reader to employ real-world tactics for security and implementation of best practices. We are not liable for any negative consequences that may result from implementing any information covered in our articles or tutorials. If this is a hardware review, it is not recommended to open and/or modify your hardware. |
More Search Engine Tricks Articles
More By Developer Shed