decko-commons/decko

View on GitHub
card/lib/generators/deck/templates/public/robots.txt

Summary

Maintainability
Test Coverage
# See http://www.robotstxt.org/wc/norobots.html
# for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-Agent: *
# Disallow: /

User-agent: *
Crawl-delay: 3
Disallow: /card/*
Disallow: /admin/*
Disallow: /account/*
Allow: /