# robots.txt
# Author: David Martin (davidm@large.com)
# This file is based on the document "A Standard for Robot Exclusion" at
# http://info.webcrawler.com/mak/projects/robots/norobots.html
# This will only work for robots that honor this file :-(
# NOTE:
# I would suggest only putting this file on webdev sites.  We
# should allow robots to access the production server.
#
# This indicates that no robots should visit this site further:
User-agent: *
Disallow: /

User-Agent: W3C-checklink
Disallow: