[Midnightbsd-cvs] www [593] trunk/robots.txt: dont hide css or js because googlebot makes wrong assumptions about mobile for their new filtering.
laffer1 at midnightbsd.org
laffer1 at midnightbsd.org
Fri Apr 17 08:06:53 EDT 2015
Revision: 593
http://svnweb.midnightbsd.org/www/?rev=593
Author: laffer1
Date: 2015-04-17 08:06:52 -0400 (Fri, 17 Apr 2015)
Log Message:
-----------
dont hide css or js because googlebot makes wrong assumptions about mobile for their new filtering.
Modified Paths:
--------------
trunk/robots.txt
Modified: trunk/robots.txt
===================================================================
--- trunk/robots.txt 2015-03-29 19:20:36 UTC (rev 592)
+++ trunk/robots.txt 2015-04-17 12:06:52 UTC (rev 593)
@@ -1,8 +1,6 @@
User-agent: *
Disallow: /cgi-bin/
Disallow: /shadowbox/
-Disallow: /css/
-Disallow: /js/
Disallow: /assets/
Disallow: /magus/auth/
Crawl-delay: 5
More information about the Midnightbsd-cvs
mailing list