How can I add a site to search?
Site pages appear in search results after the Yandex robots visit the site. For the robots to crawl and load pages:
Step 1. Make site pages visible to the bot
-
There are several ways to inform the Yandex robot about changes on the site:
Method
Automation
Recommendation
Generate and update the file. This will allow you to send information about all site URLs. The robot can process the file contents the next time it crawls the site.
Install the Yandex.Metrica tag on your site and link it to the site in Yandex.Webmaster. This way you can inform us about popular pages.
—
On the Indexing → Reindexing page in Yandex Webmaster, you can signal the indexing bot to visit specific pages of your site. You can use this method to report changes on the most important or new pages.
Helps automatically report updated, new, and deleted pages. Requires API skills.
Tip
Maintain the site quality. The more useful pages are found and uploaded to the database by the robot, the more likely they will be displayed in the search results. For more information, see the Signs of a low-quality site section.
Step 2. Hide non-public content
-
Page type
What should I do
Action pages. For example, adding an item to the basket or comparing items.
Shopping cart with a product.
Personal information. For example, the customers' delivery addresses and phone numbers.
Restrict access to data by authenticating users on the site
Duplicate page. For example, a URL with additional parameters (
https://example.com/page?id=1
).Specify which page is preferred for including in search results
After the robot crawls the site, the pages can appear in the search within two weeks.
In addition, robots can learn about the site by clicking links from other resources. This may take time and doesn't guarantee that the robot crawls all pages you would like to show in the search results.
Learn more about how Yandex search works
To track the site indexing and ranking in the search results, add the site to Yandex.Webmaster. On the Display in search page in Yandex Webmaster you can see how the site is displayed in search results and what improvements you can make.
Why is it taking so long for pages to appear in search results?
Make sure that:
- Pages are accessible to the bot (use the Server response check tool).
- The information about pages is present in the Sitemap file.
- There are available links to the pages from previously indexed site pages.
- The Disallow and noindex prohibiting directives, as well as the noindex HTML element prevent only technical and duplicate pages from indexing.
You can check what the Yandex bot knows about the page using the Check URL Status tool. To inform the bot about new or updated pages, send them for reindexing.
A system that crawls site pages and loads them into its database.
A site page that duplicates the content of another page on the same site but has a different URL.