Yandex Search Scraper

🔎 Yandex Search Scraper

Scrape public Yandex search results in seconds: organic links with titles, snippets and sitelinks, plus ads, the knowledge graph card, inline images, and the Yandex Images and Yandex Videos verticals. Pick any of six regional Yandex sites (yandex.com, .ru, .kz, .by, .uz, .com.tr). No login, no API key, no captcha solving on your side.

✨ Why use Yandex Search Scraper?

• ⚡ Fast: a typical one-page search finishes in a few seconds.
• 🛡️ Gets through the captcha wall: Yandex blocks most automated traffic. The actor rotates residential exits in the countries Yandex lets through and retries each page automatically.
• 🌍 Six regional Yandex sites: yandex.com, yandex.ru, yandex.kz, yandex.by, yandex.uz and yandex.com.tr, with language, region, period and sort filters.
• 🧩 More than blue links: ads, the knowledge graph card (with facts), inline images, Yandex Images and Yandex Videos in one run.
• 💸 Cheap and simple pricing: you pay per saved result, and proxy traffic is included in normal platform usage.
• 🔌 Familiar output shape: one dataset item per page and result type, with the same field names that popular Yandex SERP tools use, so existing pipelines keep working.

🎯 Use cases

• 📈 SEO for Russian-speaking and Central Asian markets: track where your pages rank on Yandex for your keywords.
• 🕵️ Competitor monitoring: see who buys Yandex ads on your brand or product keywords.
• 🧠 Entity research: collect knowledge graph cards (description, type, facts, official site) for companies and people.
• 🖼️ Visual research: pull image and video results with thumbnails, sources, durations and channels.
• 📰 News and reputation tracking: sort by date and limit to the last day, two weeks or month.

🚀 How to use

1. Type your search query into Search query.
2. Choose the Yandex domain and, if you like, a language, region, period or sort order.
3. Turn on the extra result types you want (ads, knowledge graph, images, videos).
4. Set Maximum results and click Start.
5. Download the results as JSON, CSV, Excel or HTML, or read them through the API.

📥 Input

{
  "text": "python tutorial",
  "maxResults": 10,
  "yandex_domain": "yandex.kz",
  "lang": "en",
  "include_organic_results": true,
  "include_knowledge_graph": true
}

📤 Output

Each dataset item is one page of one result type (item_type is organic, ads, knowledge_graph, inline_images, inline_videos, image_search or video_search). The Output table opens the results one row at a time.

Example item from a test run (trimmed to two results):

{
  "text": "python tutorial",
  "yandex_domain": "yandex.com",
  "lang": "en",
  "page_number": 1,
  "item_type": "organic",
  "result_count": 10,
  "search_domain_description": "United States",
  "search_language_description": "English",
  "next_start_page": 2,
  "organic_results": [
    {
      "position": 1,
      "title": "Python Tutorial",
      "link": "https://www.w3schools.com/python/",
      "snippet": "Learn Python with our tutorial. ... Python Database Handling. In our database section you will learn how to access and work with MySQL and MongoDB databases: Python MySQL Tutorial.",
      "displayed_link": "w3schools.com › python",
      "sitelinks": [
        {"title": "Python Lists", "link": "https://www.w3schools.com/python/python_lists.asp"},
        {"title": "Python Getting Started", "link": "https://www.w3schools.com/python/python_getstarted.asp"}
      ]
    },
    {
      "position": 2,
      "title": "The Python Tutorial — Python 3.15.0 documentation",
      "link": "https://docs.python.org/3/tutorial/index.html",
      "snippet": "This tutorial introduces the reader informally to the basic concepts and features of the Python language and system.",
      "displayed_link": "docs.python.org › tutorial"
    }
  ],
  "ads_results": [],
  "knowledge_graph": [],
  "image_results": [],
  "video_results": []
}

💰 Pricing

You pay $3 per 1,000 results ($0.003 per saved result: one organic link, ad, knowledge graph card, image or video). A one-page search with 10 organic results costs $0.03 in result fees, plus a fraction of a cent of platform usage (compute and residential proxy traffic). Web pages after the first (the first two on yandex.kz) are opened in the hosted Scrapely browser, which adds browser credits for that run: usually a few cents per deep search, whatever the number of pages. Captcha retries are never charged as results.

❓ FAQ

Is it legal to scrape Yandex? The actor only reads public search result pages that anyone can open without an account. Check the rules that apply to your use of the data, especially for personal data.

Do I need a login, an API key or my own proxies? No. The actor picks residential exits in countries Yandex lets through on its own. You can still pass your own proxy URLs.

How many results can I get per search? Yandex shows about 10 organic results per page, and you can open as many pages as Yandex serves for the search. Page 1 is fetched directly; later web pages are opened in the hosted browser once it passes the Yandex check, so a deep search takes about 30–90 seconds. Yandex Images returns about 20 results per page for up to 2 pages (about 40 images). Yandex Videos returns about 16–20 per page and can go several pages deep.

Why is a field empty? Yandex only shows ads, knowledge graph cards and image strips for some queries. When the page has none, that item type is skipped and not charged.

What if Yandex shows a captcha? Each page is retried on several fresh exits in parallel, and later web pages fall back to the hosted browser. If every attempt is blocked, the run keeps the pages it already has, says which page was blocked, and charges nothing for the missing pages.

Can I schedule it or call it from code? Yes. Use schedules, webhooks and the API like with any other Actor.

⚠️ Limits

• Web search: deeper pages need the hosted browser to pass the Yandex check. That usually works within a few tries but not always. When it fails, the run keeps the earlier pages and its status says where it stopped. Use start_page with next_start_page to continue.
• Yandex Images: up to 2 pages (about 40 images) per search.
• The language filter applies to the first web page. Later pages use Yandex's default language mix.
• Yandex may replace the region id (lr) with the region of the exit IP on web results.
• When Yandex refuses every exit on the chosen regional site for a search, the actor gets the same search from yandex.kz and says so in the run status.
• Results come from the mobile results page, so a few desktop-only blocks are not included.
• Yandex Videos filters (duration, HD) and the "recent images" filter are not available on the mobile pages and are not offered.