[Midnightbsd-cvs] www [593] trunk/robots.txt: dont hide css or js because googlebot makes wrong assumptions about mobile for their new filtering.

laffer1 at midnightbsd.org laffer1 at midnightbsd.org
Fri Apr 17 08:06:53 EDT 2015


Revision: 593
          http://svnweb.midnightbsd.org/www/?rev=593
Author:   laffer1
Date:     2015-04-17 08:06:52 -0400 (Fri, 17 Apr 2015)
Log Message:
-----------
dont hide css or js because googlebot makes wrong assumptions about mobile for their new filtering.

Modified Paths:
--------------
    trunk/robots.txt

Modified: trunk/robots.txt
===================================================================
--- trunk/robots.txt	2015-03-29 19:20:36 UTC (rev 592)
+++ trunk/robots.txt	2015-04-17 12:06:52 UTC (rev 593)
@@ -1,8 +1,6 @@
 User-agent: *
 Disallow: /cgi-bin/
 Disallow: /shadowbox/
-Disallow: /css/
-Disallow: /js/
 Disallow: /assets/
 Disallow: /magus/auth/
 Crawl-delay: 5



More information about the Midnightbsd-cvs mailing list