ViewVC Help
View File | Revision Log | Show Annotations | Download File | View Changeset | Root Listing
root/www/trunk/robots.txt
Revision: 365
Committed: Mon May 25 21:28:43 2009 UTC (14 years, 11 months ago) by laffer1
Content type: text/plain
File size: 106 byte(s)
Log Message:
Add cgi-bin directory stuff so that we don't get hammered by bots

File Contents

# Content
1 User-agent: *
2 Disallow: /cgi-bin/
3 Disallow: /shadowbox/
4 Disallow: /css/
5 Disallow: /js/
6 Disallow: /assets/