How can I add a site to search?
- Links specified in the Sitemap file.
- Page size — pages larger than 10 MB are not indexed.
- The link is placed on your site or on a third-party resource.
- The link is not prohibited for indexing in the robots.txt file.
To inform Yandex about a new site and track its indexing and ranking in the search results, add the site to Yandex.Webmaster.
Which pages are already indexed?
There are several ways to check this:
- Using the url query operator. In the Yandex search box, enter the url: query operator, site address and *. For example: url:www.example.com*.
- In Yandex.Webmaster, on the Crawl statistics section.page. For details, see the
Which site pages are included in the search?
Yandex search results are generated based on the indexing database. Pages loaded in the indexing database are analyzed using a special algorithm. If the algorithm determines that the page content matches the search query fully enough (in other words, it is relevant), this page can appear in the search results. As a result, not all site pages appear in Yandex search.
To find out which pages of your site are included in search results, go to in Yandex.Webmaster.
Sometimes pages previously included in the search may be excluded from search results. To view the list of excluded site pages, go to the page in Yandex.Webmaster.
Why is it taking so long for pages to appear in search results?
If new pages don't appear in search for a long time, make sure that:
- The information about pages is present in the Sitemap file.
- There are available links to the pages from previously indexed site pages.
- The robots.txt file doesn't include the Crawl-delay directive unless it is needed, and the Disallow and noindex prohibiting directives, as well as the noindex HTML element prevent only technical and duplicate pages from indexing.
To find out if the robot is aware of a new page and what the page's status is, use the tool. To inform the robot about new pages, send them for reindexing.
Changes to the site's position in search results
Search results are not static and can change constantly. This can happen for several reasons:
- Search algorithms changed
- Ranking algorithms are constantly being updated in order to improve search quality.
- The search database was updated
- Site characteristics are continually being recalculated based on the latest data about the pages as well as their popularity among users. The weight of ranking factors and the page that is relevant to the query may change. Site pages may get bumped out of the search index. As a result, positions in search results can also change.
- There were changes on other sites included in search results for the queries you are interested in
- Your site's position in search results might change if other resources increase their relevance for the same queries (as owners of other sites also make changes). If top positions in search are taken by suspicious sites, use this form to report it.
- The site URL or the protocol changed
- After a URL change, the site's position in search results may be lower until several search database updates have been completed (the old site pages disappear from the search index, so the ranking for matching queries may be lower for some time). If your site has a 301 redirect set up, check out the rules for processing it.
- Pages that were previously in search results are no longer shown
- To check if a page is included in search, use the Check URL status tool or enter a search query with the [url] operator(example).
- There are other changes on your site
- Any change to the site can affect its position in search results. For example, changing the site structure, URL or the content (or layout) of the page that matched certain queries.
- Site pages are considered to be of poor quality
- You can check this in Yandex.Webmaster on the
The algorithm checks pages with every search database update, so some of them may be excluded from the search. If a page doesn't show up in search results for a long time, it means that it doesn't provide good answers to user queries at the moment. page. To improve the site, follow the recommendations:
Questions and answers
The date won't be displayed in the search results next to your site pages.
Most users won't see your site if they sort the search results by date.
The robot won't know if a site page has been updated since it was last indexed. Modified pages will therefore be indexed less often, given that the number of pages the robot gets from a site each time is limited.
Your site will still be indexed even if your server doesn't provide last-modified document dates. However, you should keep in mind the following:
A large number of parameters and nested directories in the URL, or overly long URLs, may interfere with the site indexing.
The URL can be up to 1024 characters.
The Yandex robot doesn't index anchor URLs of pages, except for AJAX pages (with the #! character). For example, the http://example.com/page/#title page won't get into the robot database. The robot will index the http://example.com/page/ page (URL before the # character).