2 posts tagged with noindex.
Displaying 1 through 2 of 2. Subscribe:

RSS feeds in Google searches

The new RSS feeds (which are wonderful) are starting to show up in Google searches. I doubt this is what anyone wants. I would suggest that they be disallowed in robots.txt, or set NOINDEX, NOFOLLOW.
posted by grouse on Aug 1, 2007 - 14 comments

Userpages closed to indexing?

Revisiting this.

Metafilter is the biggest site that I can edit a page (my user page) on. I'd like to have "I am the [my name] that went to so and so school, and so and so high-school and did so-and-so" so that if someone googled my name looking for me, they could find that. However, userpages are marked NOINDEX for robots, for to stop villians from using google to harvest stuff, I assume. Given that it would be trivial to write a script to go through all the user pages and snarf anything, and given that these are The Internets, is there a reasonable expectation that an email address or other information you put on a publicly viewable page will *not* be harvested? Doesn't everyone have a spam-catcher address for this purpose?
posted by Capn on Jan 23, 2005 - 7 comments

Page: 1