User-agent: *               
Disallow: /cgi-bin                                     
Disallow: /search/         
Disallow: /author/         
Disallow: /users/                   
Disallow: /xmlrpc.php           

User-agent: GoogleBot       
Disallow: /cgi-bin                               
Disallow: /search/         
Disallow: /author/         
Disallow: /users/                   
Disallow: /xmlrpc.php          

User-agent: Yandex          
Disallow: /cgi-bin                             
Disallow: /search/         
Disallow: /author/         
Disallow: /users/                   
Disallow: /xmlrpc.php

Sitemap: https://arnest.ru/sitemap.xml