ViewVC Help
View File | Revision Log | Show Annotations | Revision Graph | Download File | Root Listing
root/midnightbsd-cvs/www/robots.txt
Revision: 1.2
Committed: Mon May 25 21:28:43 2009 UTC (14 years, 10 months ago) by laffer1
Content type: text/plain
Branch: MAIN
CVS Tags: HEAD
Changes since 1.1: +6 -0 lines
Log Message:
Add cgi-bin directory stuff so that we don't get hammered by bots

File Contents

# Content
1 User-agent: *
2 Disallow: /cgi-bin/
3 Disallow: /shadowbox/
4 Disallow: /css/
5 Disallow: /js/
6 Disallow: /assets/