2 posts tagged with noindex.
Displaying 1 through 2 of 2. Subscribe:
RSS feeds in Google searches
The new RSS feeds (which are wonderful) are starting to show up in Google searches. I doubt this is what anyone wants. I would suggest that they be disallowed in robots.txt, or set NOINDEX, NOFOLLOW.
Userpages closed to indexing?
Revisiting this.
Metafilter is the biggest site that I can edit a page (my user page) on. I'd like to have "I am the [my name] that went to so and so school, and so and so high-school and did so-and-so" so that if someone googled my name looking for me, they could find that. However, userpages are marked NOINDEX for robots, for to stop villians from using google to harvest stuff, I assume. Given that it would be trivial to write a script to go through all the user pages and snarf anything, and given that these are The Internets, is there a reasonable expectation that an email address or other information you put on a publicly viewable page will *not* be harvested? Doesn't everyone have a spam-catcher address for this purpose?
Metafilter is the biggest site that I can edit a page (my user page) on. I'd like to have "I am the [my name] that went to so and so school, and so and so high-school and did so-and-so" so that if someone googled my name looking for me, they could find that. However, userpages are marked NOINDEX for robots, for to stop villians from using google to harvest stuff, I assume. Given that it would be trivial to write a script to go through all the user pages and snarf anything, and given that these are The Internets, is there a reasonable expectation that an email address or other information you put on a publicly viewable page will *not* be harvested? Doesn't everyone have a spam-catcher address for this purpose?
Page:
1