Просмотр файла public/robots.txt
User-agent: * Allow: / Crawl-delay: 1 Disallow: /api Disallow: /admin Disallow: /login Disallow: /logout Disallow: /register Disallow: /menu Disallow: /mails Disallow: /recovery Disallow: /unsubscribe Disallow: /captcha Disallow: /online Disallow: /contacts Disallow: /ignores Disallow: /profile Disallow: /pictures Disallow: /messages Disallow: /settings Disallow: /notebooks Disallow: /authlogs Disallow: /key Sitemap: /sitemap.xml