# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /login Disallow: /sessions/new Disallow: /users/demo_user Disallow: /big_users/demo_user Disallow: /user/new Disallow: /password/request_reset User-agent: Baiduspider Disallow: / Sitemap: http://big.first.name/sitemap.xml Sitemap: http://big.first.name/blog/posts.atom