Check this out if you don't want certain content to appear in the search engine results.
Today, in that same spirit of making the lives of webmasters simpler, we're releasing detailed documentation about how we implement REP. This will provide a common implementation for webmasters and make it easier for any publisher to know how their REP directives will be handled by three major search providers -- making REP more intuitive and friendly to even more publishers on the web.
Improving on Robots Exclusion Protocol from Official Google Webmaster Central Blog


Comments
Post has no comments.