Лучший robots.txt для wordpress.

На мой взгляд лучший robots.txt для wordpress.

Лучший robots.txt для wordpress.

User-Agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: */trackback
Disallow: */feed
Disallow: /*?*
Disallow: /*?
Disallow: /wp-login.php
Disallow: /xmlrpc.php

User-Agent: Yandex
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: */trackback
Disallow: */feed
Disallow: /*?*
Disallow: /*?
Disallow: /wp-login.php
Disallow: /xmlrpc.php
Clean-param: replytocom /*

Sitemap: http://recover.nnov.ru/sitemap.xml

Учтено множество моментов касательно движка wordpress.

Leave a Reply

Статьи