cre-ne-jp/log-archiver

View on GitHub
public/robots.txt

Summary

Maintainability
Test Coverage
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
 
User-agent: *
 
# 今日・昨日は内容が常に変動するので許可しない
Disallow: /channels/*/today
Disallow: /channels/*/yesterday