[Midnightbsd-cvs] www [591] trunk/robots.txt: block auth
laffer1 at midnightbsd.org
laffer1 at midnightbsd.org
Sat Mar 21 14:00:27 EDT 2015
Revision: 591
http://svnweb.midnightbsd.org/www/?rev=591
Author: laffer1
Date: 2015-03-21 14:00:26 -0400 (Sat, 21 Mar 2015)
Log Message:
-----------
block auth
Modified Paths:
--------------
trunk/robots.txt
Modified: trunk/robots.txt
===================================================================
--- trunk/robots.txt 2015-03-21 00:21:44 UTC (rev 590)
+++ trunk/robots.txt 2015-03-21 18:00:26 UTC (rev 591)
@@ -4,6 +4,7 @@
Disallow: /css/
Disallow: /js/
Disallow: /assets/
+Disallow: /magus/auth/
Crawl-delay: 5
Sitemap: http://www.midnightbsd.org/sitemap.xml.gz
Host: www.midnightbsd.org
More information about the Midnightbsd-cvs
mailing list