4 posts tagged with robots.
Displaying 1 through 4 of 4. Subscribe:

Oreo Blue

Oreo Blue? Really? [more inside]
posted by doreur on Feb 27, 2013 - 231 comments

RSS feeds in Google searches

The new RSS feeds (which are wonderful) are starting to show up in Google searches. I doubt this is what anyone wants. I would suggest that they be disallowed in robots.txt, or set NOINDEX, NOFOLLOW.
posted by grouse on Aug 1, 2007 - 11 comments

Suggested use of robots.txt for better searching of MeFi and related subdomains

Robots.txt for the <tagname>.metafilter.com domains should exclude all rebots. Currently the robots reindex the entire site for each subdomain.
posted by Sharcho on Jan 15, 2006 - 23 comments

Help Me Find a Thread

There was something posted a few weeks ago (can't even remember if it was in the blue or the green) about a website that allows you to design your own paper robots or creatures and then fold them up according to a pre-made template. Trigger any memories?
posted by jeremias on Dec 4, 2005 - 4 comments

Page: 1