Check URL status

Check URL status is a tool to track how your site is indexed by Yandex. It allows you to learn the page status in search results: whether it is crawled, whether it is involved in the search, and also why it was excluded from search results.

  1. Page check
  2. Viewing reports
  3. Data filtering

Page check

To get information about page indexing, follow these steps in Yandex.Webmaster:

  1. Choose the site with the page you need to check from the list.
  2. Go to the Indexing → Check URL Status section.
  3. Enter the page URL and click Check.

    Note. In the field, you can enter the full URL or the relative path from the site root beginning with “/”. For example, if you enter the URL as http://example.com, the system processes information about the page with the URL http://example.com. If you enter /news, the system processes information about the page with the URL http://my-website.com/news.

The system collects the data about the page and generates a report.

During the data collection, the report has the “Is being validated” status. It takes a few minutes to collect and process information. In some cases this may take several hours. As soon as the system finishes processing the data, the report status switches to “Completed”. The “Could not create report” status indicates that an error has occurred on the service side. In this case, try checking the page later.

Viewing reports

To view the report, click the More info button.

The report is based on the current state of the search database and on the latest data received from the indexing robot:

  • Page status in the search.
  • Page status during the last crawl.
  • Date and time of the last search database build and last crawl.
  • Page URL.
  • Page title (the content of the HTML title element).

You can use filters to view a report generated for a certain page.

To delete a report, click the icon next to the page address, then click Remove.

Note. If page content has been altered, the robot will automatically keep track of that. Search result data will be updated the next time the search base is built.

Data filtering

You can quickly find the reports about the checks of certain pages. You can filter data by page address by clicking the icon:

Enter part of a URL.

To make a list of pages with a certain text in the address, choose the URL contains value from the list and enter the address fragment.

Use special characters.

You can use special characters to match the beginning of the string or a substring, and set more complex conditions using regular expressions. To do this, choose URL matches from the list and enter the condition in the field. You can add multiple conditions by putting each of them on a new line.

For conditions, the following rules are available:

  • Match any of the conditions (corresponds to the “OR” operator).
  • Match all conditions (corresponds to the “AND” operator).
Characters used for filtering
Character Description Example
* Matches any number of any characters

Display data for all pages that start with https://example.com/tariff/, including the specified page: / tariff / *

Using the * character

The * character can be useful when searching for URLs that contain two specific elements or more.

For example, you can find news or announcements for a certain year: /news/*/2017/.

@ The filtered results contain the specified string (but don't necessarily strictly match it) Display information for all pages with URLs containing the specified string: @tariff
~ Condition is a regular expression Display data for pages with URLs that match a regular expression. For example, you can filter all pages with address containing the fragment ~table|sofa|bed repeated once or several times.
! Negative condition Exclude pages with URLs starting with https://example.com/tariff/: !/tariff/*

The use of characters isn't case sensitive.

The @,!, ~ characters can be used only at the beginning of the string. The following combinations are available:

Operator Example
!@ Exclude pages with URLs containing tariff: !@tariff
!~ Exclude pages with URLs that match the regular expression