---
metadata:
  - name: generator
    content: Diplodoc Platform v5.55.2
alternate:
  - https://yandex.com/support/webmaster/en/troubleshooting/site-indexing.md
  - https://yandex.com/support/webmaster/tr/troubleshooting/site-indexing.md
  - href: en/troubleshooting/site-indexing.md
    type: text/markdown
    title: Markdown version
  - href: ../llms.txt
    type: text/markdown
    title: llms.txt
---
> **Documentation Index:** Fetch the complete configuration index at https://yandex.com/support/webmaster/en/llms.txt


# Site indexing




{% cut "Question about displaying my site in search results" %}


Check if the pages are shown in search. To do this, enter the URL of the page you want to check in the Yandex search bar:



{% list tabs radio %}

- The page appears in search results

  This means that the page is already indexed, that is, [loaded to the robot's database](https://yandex.com/support/webmaster/en/yandex-indexing/site-indexing.md#download). If you don't find a page by a specific query or it's ranking low, try [finding out](https://yandex.com/support/webmaster/en/site-indexing/rank-diy.md) on your own the reason for the change in the site's ranking.
    
  Or clarify the question:


  {% list tabs radio %}

  - The site's position on queries dropped
  
    Check out the [reasons for changes in ranking](https://yandex.com/support/webmaster/en/troubleshooting/rank.md#site-position), and [check the site](https://webmaster.yandex.com/site/diagnosis/threats/) for security and violations. If Yandex Webmaster finds a threat or violation, follow the recommendations provided in the service.
  
    {% cut "There are no violations or threats on the site" %}
  
    Changes in the site's search ranking are acceptable in most cases. It may be due to constant adjustments of algorithms, the dynamics of search results, or fluctuations in site popularity.

    Make sure that the queries for which your site held leading positions had sufficient impressions over time. To do this, compare the [statistics on your search queries](https://yandex.com/support/webmaster/en/service/statistics.md) in Yandex Webmaster with the [Wordstat](https://wordstat.yandex.com/#!/history) query history.

    When analyzing site rankings, keep in mind that search results are personalized. For example, for frequent site visitors a search query may appear at the top of the ranking, while for other search users your site may occupy other positions.
    

    {% cut "The site was a leader for a long time " %}
    
    Contact the support service if the ranking change is accompanied by all listed conditions:

    - the site was a leader for a long time, taking into account the dynamism and personalization of search results;
    - site ranking changed by more than a few dozen points (for smaller changes, check that your site meets the recommendations under [How to improve site ranking in search results](https://yandex.com/support/webmaster/en/yandex-indexing/rank.md#rank));
    - Site traffic decreased.

    {% cut "Fill out the form" %}
    
    



    <div style="padding: 15px;
          margin: 10px 0;
          background: #FFFFFF;
          border-radius: 10px;
          border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4556/?&theme1=Pozitsii sayta po zaprosam ponizilis&theme2=Na sayte net narusheniy i ugroz&iframe=1&lang=en">
    </iframe>
    </div>
  

  
    {% endcut %}
    

    {% endcut %}
  
  
    {% endcut %}
    
  
  - The site has low ranking in the search results
  
    If your site doesn't have high ranking for some queries, it may be that it didn't gain sufficient relevance yet. Check the site metrics described in this section.
    
    {% cut "The reasons for the site's low position remain unclear" %}



  
    <div style="padding: 15px;
          margin: 10px 0;
          background: #FFFFFF;
          border-radius: 10px;
          border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4558/?&theme1=Sayt razmeshchayetsya nizko v rezultatakh poiska&theme2=Prichiny nizkikh pozitsiy sayta ostalis neyasny&iframe=1&lang=en">
    </iframe>
    </div>


  
    {% endcut %}
    
  
  - Another site page is found by the certain query
  
    Use the `url` operator ([example](https://yandex.ru/search/?text=url%3Ahttps%3A%2F%2Fwebmaster.yandex.ru&lr=213)) to check if a page is included in search.
    
    {% list tabs radio %}
    
    - The page isn't in search
    
      - The page may be a [duplicate](*дубль). For information about how to check and fix this, see [Duplicate pages](https://yandex.com/support/webmaster/en/robot-workings/double.md). Also, the page may not be included in the search or disappear from it for [other reasons](https://yandex.com/support/webmaster/en/site-indexing/excluded-pages.md).
      - If the site changed its URL but the page is displayed in the search at the old URL, make sure you [moved the site correctly](https://yandex.com/support/webmaster/en/yandex-indexing/moving-site.md#old-url).  
    
    
    - The page is in the search
    
      A special algorithm determines if the page will be displayed in the search results or not. For example, for the page to be displayed, its content must match the search query. To learn more, see [Stage 4. Generating search results](https://yandex.com/support/webmaster/en/yandex-indexing/site-indexing.md#search).
        
        
      {% cut "The page in the search doesn't fully match the query" %}
    



      <div style="padding: 15px;
            margin: 10px 0;
            background: #FFFFFF;
            border-radius: 10px;
            border: 1px solid var(--yc-color-line-generic);">
      <iframe style="background: #FFFFFF;"
            height="700"
            width="100%"
            frameborder="0"
            src="https://forms.yandex.com/surveys/4560/?&theme1=Po opredelennomu zaprosu nakhoditsya drugaya stranitsa sayta&theme2=Stranitsa est v poiske&theme3=Stranitsa. kotoraya nakhoditsya v poiske. polnostyu ne sootvetstvuyet zaprosu&iframe=1&lang=en">
      </iframe>
      </div>


    
      {% endcut %}
  
    {% endlist %}
  
  
  - The site is not in the search results
  
    If you don't find new site pages in the search, go to the [How do I add a site to search?](https://yandex.com/support/webmaster/en/robot-workings/robot.md) section. If the pages were previously in the search, but are missing now, check out the [reasons for excluding pages](https://yandex.com/support/webmaster/en/site-indexing/excluded-pages.md).
  
  
  
  - Website traffic decreased


    If you notice a decrease in website traffic, check it for any detected [violations or security issues](https://yandex.com/support/webmaster/en/diagnosis/mistakes.md#threats).
    

    {% cut "There are no violations or threats on the site " %}
    

    Traffic changes may be related to changes in demand. Check the dynamics of site visitors’ interests using [the word selection history](https://wordstat.yandex.com/#!/history) or the “Demand” metric in [search query monitoring](https://yandex.com/support/webmaster/en/service/popular-queries.md).


    {% cut "I checked. Demand hasn’t changed, but traffic has dropped" %}
    
    Traffic from search results may decrease due to changes in the site’s ranking.

    Site positions for queries are constantly changing. Possible reasons for this are:

    - changes in ranking (formulas and classifiers are retrained, factors emerge and are updated), quality metrics (new aspects, changes in instructions), anti-spam and anti-fraud algorithms;
    - changes in user preferences (demand has fallen or shifted to other products or services, user expectations, navigation patterns, choices, etc. have changed);
    - changes in the competitive environment (new sellers, services, new types of content and sites have appeared, content, pricing, service, etc. have changed);
    - changes on the sites: pages may have entered or dropped out of search; titles, meta tags, page content may have changed; other sites may have become more user-friendly, gained more audience trust.
    
    [Details on the reasons](https://yandex.com/support/webmaster/en/yandex-indexing/rank.md#site-position)
    
    
    {% cut "I checked. The change in traffic is significant and affects a large portion of the site" %}
    



    <div style="padding: 15px;
          margin: 10px 0;
          background: #FFFFFF;
          border-radius: 10px;
          border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4556/?&theme1=Snizilas poseshaemost saita&theme2=Rekomendacii ne pomogli&iframe=1&lang=en">
    </iframe>
    </div>


    
    {% endcut %}


    {% endcut %}
    
        
    {% endcut %}
    
  
  - Report unauthorized copying of information from my site
    
    If another resource only contains the content that is identical to yours, this is not enough to exclude the site from the search results.
    
    To protect your copyright, you can file a complaint directly with the administrator of the site whose content you believe to be identical to yours, or use other legal means to protect your rights.
    
    If you can't come to an agreement with the site administration, try writing to the hosting provider of the site.
        
    
    {% cut "Recommendations didn't help" %}
    



    <div style="padding: 15px;
          margin: 10px 0;
          background: #FFFFFF;
          border-radius: 10px;
          border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4559/?&theme1=Snizilas poseshaemost saita&theme2=Rekomendacii ne pomogli&iframe=1&lang=en">
    </iframe>
    </div>


    
    {% endcut %}
  
  
  {% endlist %}


- The page doesn't appear in search results

  This means that the site or some of the pages haven't been indexed by the Yandex robot yet. To learn more about how the robot crawls sites, see [How does the Yandex search work?](https://yandex.com/support/webmaster/en/yandex-indexing/site-indexing.md).
  
  Clarify your question:


  {% list tabs radio %}
  
  - The site has been added to Yandex Webmaster, but didn't appear in the search yet
     
    <!-- source: en/_includes/popup/id-feedback/add-wm1.md -->
    As a rule, sites added to Yandex Webmaster appear in search results within two weeks. If this doesn't happen, check if the site indexing isn't prohibited in the [robots.txt](https://yandex.com/support/webmaster/en/controlling-robot/robots-txt.md) file or with [meta tags](https://yandex.com/support/webmaster/en/controlling-robot/metatags.md#html).
    <!-- endsource: en/_includes/popup/id-feedback/add-wm1.md -->
    
    <!-- source: en/_includes/popup/id-feedback/add-wm2.md -->
    The site may also be unavailable due to a server error. You can check the site availability with the [Server response check](https://webmaster.yandex.com/tools/server-response/) tool.
    <!-- endsource: en/_includes/popup/id-feedback/add-wm2.md -->
    
    <!-- source: en/_includes/popup/id-feedback/add-wm3.md -->
    If the site URL changed, the robot might not have enough time to track it. Check if the [site addresses are configured correctly](https://yandex.com/support/webmaster/en/yandex-indexing/site-addresses.md).
    <!-- endsource: en/_includes/popup/id-feedback/add-wm3.md -->
    
    {% cut "The site is available for the robot, but doesn't appear in the search " %}
    
    
    Send pages to be visited by the robot using the [Reindex pages](https://webmaster.yandex.com/site/tools/add-url/) tool. The pages will appear in the search within two weeks.
    
    
    {% cut "Recommendations didn't help" %}
    


    
    
    <div style="padding: 15px;
          margin: 10px 0;
          background: #FFFFFF;
          border-radius: 10px;
          border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/2640/?&theme=Sait dobavlen v Webmaster no ne poyavilsya v poiske&iframe=1&lang=en">
    </iframe>
    </div>
    
    
    
  
    
    {% endcut %}
  
    
    {% endcut %} 
    
  
  - New site pages aren't included in search


    Check out [recommendations](https://yandex.com/support/webmaster/en/robot-workings/robot.md#not-in-search) that help you add pages in the search.



    
    {% cut "The pages are accessible to the robot and sent for reindexing, but do not appear in the search for more than three weeks" %}
    
    <div style="padding: 15px;
          margin: 10px 0;
          background: #FFFFFF;
          border-radius: 10px;
          border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&theme1=Sait ploho indeksiruetsya&theme2=Novie stranici ne popadaut v poisk&iframe=1&lang=en">
    </iframe>
    </div>
    
    
    {% endcut %}
    
    
    

    
  - Site or pages disappeared from the search results
  
    For more information about why pages may disappear from search and recommendations on how to fix this, see the [Why are pages excluded from the search?](https://yandex.com/support/webmaster/en/site-indexing/excluded-pages.md) section.
  
    If the problem wasn't solved, specify the reason:

    {% list tabs radio %}
    
    - The page is accessible to the robot and sent for reindexing, but does not appear in the search



    
      <div style="padding: 15px;
           margin: 10px 0;
           background: #FFFFFF;
           border-radius: 10px;
           border: 1px solid var(--yc-color-line-generic);">
        <iframe style="background: #FFFFFF;"
              height="700"
              width="100%"
              frameborder="0"
              src="https://forms.yandex.com/surveys/4545/?iframe=1&lang=en">
        </iframe>
      </div>


    
    - Different site pages are recognized as duplicates

      Pages with different content can be considered duplicates if they responded to the robot with an error message (for example, in case of a stub page on the site). Check how the pages respond now. If pages return different content, [send them for re-indexing](https://webmaster.yandex.ru/site/indexing/reindex/) — this way they can get back in the search results faster.

      To prevent pages from being excluded from the search if the site is temporarily unavailable, configure the [503 HTTP response code](https://yandex.com/support/webmaster/en/error-dictionary/http-codes.md#server-5xx).
      



      <div style="padding: 15px;
           margin: 10px 0;
           background: #FFFFFF;
           border-radius: 10px;
           border: 1px solid var(--yc-color-line-generic);">
        <iframe style="background: #FFFFFF;"
              height="700"
              width="100%"
              frameborder="0"
              src="https://forms.yandex.com/surveys/4545/?iframe=1&lang=en">
        </iframe>
      </div>




    - The page was found to be in low demand and removed from the search

      Excluding pages from the search results is not an error on the part of a site or the indexing robot: it excludes pages that users won't be able to find using search queries. Therefore, their exclusion shouldn't affect the visibility of indexed pages on the site. To learn more, see [Low-value or low-demand pages](https://yandex.com/support/webmaster/en/site-indexing/low-demand.md#low-demand).

      Contact support if:

      - Pages were ranked high in the search results before they were excluded.
      - The site's position after the exclusion of pages decreased dramatically.
      - The number of click-throughs from the search engine reduced significantly after the pages were excluded.


      {% cut "Fill out the form" %}




      <div style="padding: 15px;
           margin: 10px 0;
           background: #FFFFFF;
           border-radius: 10px;
           border: 1px solid var(--yc-color-line-generic);">
        <iframe style="background: #FFFFFF;"
              height="700"
              width="100%"
              frameborder="0"
              src="https://forms.yandex.com/surveys/4545/?iframe=1&lang=en">
        </iframe>
      </div>



      
      {% endcut %}
      
    - Another questions about excluding pages




      <div style="padding: 15px;
           margin: 10px 0;
           background: #FFFFFF;
           border-radius: 10px;
           border: 1px solid var(--yc-color-line-generic);">
        <iframe style="background: #FFFFFF;"
              height="700"
              width="100%"
              frameborder="0"
              src="https://forms.yandex.com/surveys/4544/?iframe=1&lang=en">
        </iframe>
      </div>


    
    {% endlist %}
    
  
  {% endlist %}
  

{% endlist %}


{% endcut %}

{% cut "The site or individual pages won't get updated in the search" %}


To speed up how quickly changes in site pages appear in the search results, see [How do I reindex a site?](https://yandex.com/support/webmaster/en/robot-workings/site-reindex.md)


If you still have questions or have any difficulties, specify the topic:

{% list tabs radio %}

- The pages are accessible to the robot, but the “Error” status persists



  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/2640/?&iframe=1&lang=en">
    </iframe>
  </div>

- The pages are accessible to the robot and sent for reindexing, but do not appear in the search for more than three weeks



  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&iframe=1&lang=en">
    </iframe>
  </div>

- Information on the site has been modified, but the old version is displayed in the search results

  Make sure that:
  
  - The pages are accessible to the bot by using the [Server response check](https://webmaster.yandex.ru/tools/server-response/) tool.
  - The information about pages is present in the [Sitemap](https://yandex.com/support/webmaster/en/controlling-robot/sitemap.md) file.  
  - The Disallow and noindex prohibiting directives and the noindex HTML element in the [robots.txt](https://yandex.com/support/webmaster/en/controlling-robot/robots-txt.md) file prevent only technical and duplicate pages from indexing.


  {% cut "Recommendations didn't help" %}



  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&iframe=1&lang=en">
    </iframe>
  </div>

  {% endcut %}
  

- The site or individual pages are prohibited in robots.txt, but are still in the search
  
  If you followed the [instructions](https://yandex.com/support/webmaster/en/yandex-indexing/removing-from-index.md) when deleting the site pages and more than two weeks passed after the site was crawled by the Yandex robot, fill out the form below:



  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&iframe=1&lang=en">
    </iframe>
  </div>

- The site or individual pages are prohibited in robots.txt, but are still in the search

  If you use a redirect, the robot will gradually track redirects and the old pages will disappear from the search results as it crawls the site. To have the bot learn about the changes faster, [send the pages for reindexing](https://webmaster.yandex.ru/site/tools/add-url/).

  If the page URLs change with the change of the site's domain name, it may take more than a month to update the search data. Check if the [site addresses are configured correctly](https://yandex.com/support/webmaster/en/yandex-indexing/site-addresses.md).

  {% cut "The pages are sent for reindexing, but aren't removed from the search for more than two weeks" %}



  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&iframe=1&lang=en">
    </iframe>
  </div>
  
  {% endcut %}
  

{% endlist %}




{% endcut %}

{% cut "How do I delete a site or individual pages from search" %}


See recommendations in the [How do I exclude pages from the search?](https://yandex.com/support/webmaster/en/yandex-indexing/removing-from-index.md) section.



<!-- source: en/_includes/popup/id-popup/form-intro.md -->
Tell us what your question is about so we can direct you to the right specialist:
<!-- endsource: en/_includes/popup/id-popup/form-intro.md -->






{% list tabs radio %}

- The site or individual pages are prohibited in robots.txt, but are still in the search

  If you followed the [instructions](https://yandex.com/support/webmaster/en/yandex-indexing/removing-from-index.md) when deleting the site pages and more than two weeks passed after the site was crawled by the Yandex robot, fill out the form below:



  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&theme=Sayt ili otdelnyye stranitsy zapreshcheny v robots.txt. no prodolzhayut nakhoditsya v poiske&iframe=1&lang=en">
    </iframe>
  </div>


- The old pages have been deleted and redirect to new ones, but are still present in the search

  If you used a redirect, [submit pages for reindexing](https://webmaster.yandex.com/site/tools/add-url/).


  {% cut "The pages are sent for reindexing, but aren't removed from the search for more than two weeks" %}
  


  <div style="padding: 15px;
       margin: 10px 0;
       background: #FFFFFF;
       border-radius: 10px;
       border: 1px solid var(--yc-color-line-generic);">
    <iframe style="background: #FFFFFF;"
          height="700"
          width="100%"
          frameborder="0"
          src="https://forms.yandex.com/surveys/4545/?&theme1=Staryye stranitsy udaleny i perenapravlyayut na novyye. no prodolzhayut prisutstvovat v poiske&theme2=Stranitsy otpravleny na pereobkhod. no ne udalyayutsya iz poiska dolshe dvukh nedel&iframe=1&lang=en">
    </iframe>
  </div>

{% endcut %}


{% endlist %}




{% endcut %}

{% cut "Images are poorly indexed" %}

To ask a question, write to [technical support](https://yandex.com/support/images/troubleshooting.html) of [Yandex Images](https://yandex.com/images/).

{% endcut %}

{% cut "Videos are poorly indexed" %}

To ask a question, contact [technical support](https://yandex.com/support/video/en/troubleshooting/for-webm.html)of [Yandex Video Search](http://yandex.com/video).

{% endcut %}

{% cut "Question about the robots.txt file" %}


See the [recommendations for working with the `robots.txt` file](https://yandex.com/support/webmaster/en/controlling-robot/robots-txt.md).






<div style="padding: 15px;
     margin: 10px 0;
     background: #FFFFFF;
     border-radius: 10px;
     border: 1px solid var(--yc-color-line-generic);">
  <iframe style="background: #FFFFFF;"
        height="700"
        width="100%"
        frameborder="0"
        src="https://forms.yandex.com/surveys/3759/?&theme=Ispolzovaniye fayla robots.txt&iframe=1&lang=en">
  </iframe>
</div>



{% endcut %}

{% cut "Question about the Sitemap file" %}


For information about the file format and requirements, see [Using the Sitemap file](https://yandex.com/support/webmaster/en/controlling-robot/sitemap.md).






<div style="padding: 15px;
     margin: 10px 0;
     background: #FFFFFF;
     border-radius: 10px;
     border: 1px solid var(--yc-color-line-generic);">
  <iframe style="background: #FFFFFF;"
        height="700"
        width="100%"
        frameborder="0"
        src="https://forms.yandex.com/surveys/4546/?&theme=Sitemap&iframe=1&lang=en">
  </iframe>
</div>



{% endcut %}

{% cut "The robot creates an excessive load on the site or server" %}


See [recommendations for reducing the load](https://yandex.com/support/webmaster/en/robot-workings/check-yandex-robots.md) on the site.






<div style="padding: 15px;
     margin: 10px 0;
     background: #FFFFFF;
     border-radius: 10px;
     border: 1px solid var(--yc-color-line-generic);">
  <iframe style="background: #FFFFFF;"
        height="700"
        width="100%"
        frameborder="0"
        src="https://forms.yandex.com/surveys/4547/?&theme=Robot sozdayet chrezmernuyu nagruzku na sayt ili server&iframe=1&lang=en">
  </iframe>
</div>



{% endcut %}


<!-- source: en/_includes/footer.md -->
<div width="100%" align="center" class="main-footer"> 
<br><br><br>
You can also go to 
<br><br>




[![](../_assets/logo/logo-pic.svg)](https://webmaster.yandex.com/) [![](../_assets/logo/logo-en.svg)](https://webmaster.yandex.com/)



</div>


<!-- source: en/_includes/styles/footer-style.md -->

<!-- endsource: en/_includes/styles/footer-style.md -->
<!-- endsource: en/_includes/footer.md -->

<!-- source: en/_includes/support-button-styles.md -->

<!-- endsource: en/_includes/support-button-styles.md -->

<!-- source: en/_includes/border-style.md -->

<!-- endsource: en/_includes/border-style.md -->

[*дубль]: A site page that duplicates the content of another page on the same site but has a different URL.