Added "Host: Directive" for Yandex. This line is useless, but prevents their "webmaster central" to send me unneccesary "warnings". "Host: kasu.at" literaly says that this site is available under kasu.at, not www.kasu.at

2016-09-17 10:39:01 +02:00
parent 9b0967adc8
commit 8595959872
1 changed files with 3 additions and 2 deletions
--- a/src/kasu/templates/robots.txt
+++ b/src/kasu/templates/robots.txt
@@ -1,4 +1,5 @@
 User-agent: *
-Disallow: /cgi-bin/
 Disallow: /admin/
-Disallow: /users/
+Disallow: /cgi-bin/
+Disallow: /users/
+host: example.com