The Crawl-delay directive
From February 22, 2018, Yandex ignores the Crawl-delay directive.
To set the speed at which robots downloads the site pages, use the Site crawl rate in Yandex.Webmaster.
Working with Yandex.Webmaster
Site diagnostics
Search queries
Indexing
Tools
Indexing
Robots.txt
IndexNow
Indexing localized pages
Moving the site or mirrors
Layout of search results
Search appearance
Recommendations for creating sites
Advice for webmasters
Site content and partner programs
Semantic page markup
Schema.org
Supported schemas from Schema.org
References
Русский
English
You can also go to
