Skip to content

WiAutomation Scraper

Try for free

Scrape industrial automation spare parts from WiAutomation (any country site, e.g. ae.wiautomation.com): product name, part number, brand, OEM description, price, stock, condition, category, GTIN and HS code. Whole catalogue, brands, categories or part numbers. No login needed.

⚙️ WiAutomation Scraper

Get the industrial automation spare parts catalogue of the WiAutomation online shop as clean rows: product name, part number, brand, OEM description, price, stock, condition, warranty, category, GTIN and HS code. Scrape a whole country site (for example ae.wiautomation.com), one brand, one category, or look up exact part numbers. No login, no browser.

✨ Why use WiAutomation Scraper?

  • 📦 The whole catalogue or just a slice: a country site's home page gives every product it lists; a brand, category or brand + category page narrows it down.
  • 🔎 Part number lookup: paste manufacturer part numbers (dashes and spaces don't matter) and get every matching listing, new and refurbished.
  • 💱 Local prices: prices come in the currency of the country site you choose (AED on ae.wiautomation.com, USD on us.wiautomation.com, EUR on it.wiautomation.com ...).
  • 🧾 Procurement fields: OEM description, condition (new / refurbished), warranty, stock line, GTIN / EAN and HS commodity code on every row.
  • ⚡ Fast and light: reads the shop's server-rendered product pages over plain HTTP, many at once, with automatic retries.

🎯 Use cases

  • 🏭 Spare parts sourcing: check price and stock of the parts on your bill of materials across brands.
  • 📈 Price monitoring: track prices of Siemens, ABB, Omron, Schneider Electric and other brands over time.
  • 🗂️ Catalogue building: load part numbers, OEM descriptions and HS codes into your ERP or quoting tool.
  • 🧮 Market research: compare what is offered new versus refurbished per brand and category.

🚀 How to use

  1. Paste WiAutomation URLs into Start URLs (home page, brand, category, brand + category, or product pages), and/or part numbers into Part numbers.
  2. Set Max products (0 = no limit).
  3. Run the actor.
  4. Download the results as JSON, CSV or Excel, or read them through the API.

📥 Input

FieldWhat it does
startUrlsWiAutomation pages on any country site. Home page = whole catalogue; /siemens = a brand; /power-supply = a category; /mean-well/power-supply (or its /list page) = a brand in a category; a product page = that product. Product sitemap files (.xml) work too.
partNumbersExact part numbers to look up, e.g. 6ES7214-1AG40-0XB0.
maxItemsStop after this many products in total (0 = no limit).
siteCountry site for part number lookups (sets the currency). Start URLs keep their own site.
proxyConfigurationProxy settings. Datacenter proxies work well.
{
  "startUrls": [{ "url": "https://ae.wiautomation.com/mean-well/power-supply" }],
  "partNumbers": ["6AV2100-0AA03-0AA5"],
  "maxItems": 100,
  "site": "ae"
}

📤 Output

FieldDescription
nameProduct name as shown on the page
partNumberPart number (the shop's SKU, written without separators)
brandManufacturer brand
descriptionOEM description of the part
price, currency, priceTextPrice on the country site, its currency and the price as displayed
availability, stockText, stockQuantityAvailability, the stock line (e.g. "15 In stock") and the number when the shop shows one
shippingNoteShipping line when shown (e.g. "14 Shipped within 3 days")
condition, warrantyNew / Refurbished and the warranty line
category, subCategoryCategory path from the breadcrumb
gtin, hsCodeGTIN / EAN and HS commodity code
imageUrl, url, productId, siteImage, product page, shop product id and country site
searchInputThe start URL or part number that found the row
{
  "name": "TU512 ABB - I/O Terminal Unit 1SVP426471R1000",
  "partNumber": "1SVP426471R1000",
  "brand": "ABB",
  "description": "TU512 Terminal Module Expansion",
  "price": 1212.78,
  "currency": "AED",
  "priceText": "AED 1,212.78",
  "availability": "In stock",
  "stockText": "1 In stock",
  "stockQuantity": 1,
  "condition": "Refurbished",
  "warranty": "12 Months Warranty",
  "category": "MODULES",
  "subCategory": "AC500",
  "gtin": "4013614348594",
  "url": "https://ae.wiautomation.com/abb/modules/ac500/1SVP426471R1000",
  "site": "ae"
}

❓ FAQ

Do I need an account, cookies or a browser? No. The actor reads the public product pages that anyone can open.

How many products can I get? As many as the shop lists. The whole catalogue of one country site is several hundred thousand products; set Max products to 0 and give the run enough time (a large catalogue takes hours).

Category pages show "No results" without a browser. Does that matter? No. The shop fills its category grids with scripts after the page loads. This actor finds products through the shop's own product sitemaps and reads each product page, so it does not depend on those grids.

How long does a whole catalogue take? About 15 products per second at the default 2 GB memory and about 23 per second at 4 GB (measured on ae.wiautomation.com). A country site lists several hundred thousand products, so a full run takes several hours: raise the run timeout, or split the work by brand, category or sitemap file and run the parts side by side.

What if a field is empty? The shop does not show it for that product (for example no stock number, or no GTIN). Fields are never invented.

Can I schedule it or use the API? Yes. Schedule runs in the console or start them through the API and read the dataset as JSON, CSV or Excel.

⚠️ Limits

  • Products are found through the shop's product sitemaps; a product the shop leaves out of its sitemaps is only reachable by its product URL.
  • A category page matches products whose page address contains that category; brand + category pages match that address prefix.
  • Prices are the ones shown to visitors of the chosen country site; quantity discounts and shipping costs are not included.
  • The shop's site search is not used; part numbers are matched against the product addresses and then checked on the product page.

Related actors

//From the blog\\

Latest articles

All articles

The internet is full of data.
Start owning yours.

Scrape.ly gives you the infrastructure, the tooling, and the team to extract, process, and operationalize web data at any scale. Setup takes minutes.

No credit card. No setup calls.