andey/bestofama

View on GitHub
public/robots.txt

Summary

Maintainability
Test Coverage
# robots.txt for http://bestofama.com/
Sitemap: http://s3.bestofama.com/sitemaps/sitemap.xml.gz
User-agent: *
Disallow: /cdn-cgi/
Disallow: /u/
Disallow: /r/