User-agent: Googlebot User-agent: MSNbot User-agent: Yahoobot User-agent: Bingbot User-agent: * Allow: / Crawl-Delay: 20