Google is offering an option for a faster crawl rate
posted by Sharcho on Oct 22, 2006 - 8 comments

It's possible that DNS wildcards on metafilter.com are causing problems for the Google crawler. I suggest deleting the redundant DNS entries, and using a 301 redirect for http://metafilter.com/ to go to http://www.metafilter.com/
posted by Sharcho on Jan 6, 2006 - 18 comments

Request: Google Sitemaps for MetaFilter to improve search quality.
posted by Sharcho on Oct 14, 2005 - 173 comments