Просмотр файла robots.txt

User-agent: *
Allow: /
Clean-param: SID&rand
Disallow: /input.php
Disallow: /pages/login.php
Disallow: /pages/registration.php
Disallow: /cgi-bin/
Disallow: /themes/
Disallow: /images/
Disallow: /games/
Disallow: /votes/
Disallow: /mail/
Crawl-delay: 1