# robots.txt - webbot instructions - info from http://www.robotstxt.org/ # allow all bots, this file is here to fix "missing robots.txt" error entry in the log User-agent: * Disallow: