Structured data from books.toscrape.com

What this example returns

The dataset’s “Pages” view shows 21 columns: Page, Status, Main type, Main entity, Title, Meta description, Canonical, Price, Currency, Availability, Rating, Reviews, Author, Published, Address, Schema types, Entities, Missing required, Open Graph, Twitter card, and HTTP. See every output field.

What each setting does

The input this example runs Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

Start URLs startUrls

https://books.toscrape.com/

Pages to extract, one per line. A missing https:// is added automatically. Duplicates are extracted once. Every listed page is extracted; Max discovered pages only limits pages found through sitemaps and link crawling.

Max discovered pages maxCrawlPages

15

Maximum number of pages taken from sitemaps and link crawling (on top of the start URLs). 0 means no limit.

Default: 20 → this example uses 15

Link crawl depth crawlDepth

0

Follow links on the same website this many levels deep from each start URL. 0 extracts only the listed pages (and sitemap pages).

Only pages with structured data onlyPagesWithStructuredData

No

Skip pages that have no JSON-LD, Microdata or RDFa at all.

Output rows outputMode

One row per page

One row per page (with all entities nested), or one row per schema.org entity (handy for product or event feeds). Charging is per page either way.

Data to extract syntaxes

json-ld, microdata, rdfa, opengraph, twitter, meta

Which kinds of markup to read. All are on by default; RDFa parsing is the slowest, so drop it for large crawls if you do not need it.

Validation hints validateSchema

Yes

Check each entity against Google rich result requirements and list missing required and recommended properties.

Include raw markup data includeRawData

Yes

Add the complete raw JSON-LD, Microdata and RDFa items to each row (next to the normalized fields).

Include headings outline includeHeadings

Yes

Add the page's H1 to H6 outline (up to 200 headings).

Max parallel requests maxConcurrency

16

How many pages are downloaded at the same time (at most 8 per website).

Page timeout (seconds) requestTimeoutSecs

20

Give up on a page after this many seconds per attempt.

{
  "startUrls": [
    "https://books.toscrape.com/"
  ],
  "crawlDepth": 0,
  "maxCrawlPages": 15,
  "onlyPagesWithStructuredData": false,
  "outputMode": "pages",
  "syntaxes": [
    "json-ld",
    "microdata",
    "rdfa",
    "opengraph",
    "twitter",
    "meta"
  ],
  "validateSchema": true,
  "includeRawData": true,
  "includeHeadings": true,
  "maxConcurrency": 16,
  "requestTimeoutSecs": 20
}

What it costs

You pay for the events the actor reports, such as each result or page it produces. Platform usage is included in the event prices: compute, proxies, browser and storage cost nothing extra.

• Extracted page$0.0011One web page successfully fetched and extracted (failed, blocked and filtered pages are free).

Full pricing

When to use this example

From the Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta readme:

Other ways to run Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta

• Blog posts from a sitemap, 15 pagesBlogPosting entities found via the crawlee.dev sitemap.
• Crawl a bookstore 2 levels deep, 15 pagesStructured data from pages linked from a start URL.
• Recipe, product and movie pages, 3 URLsSchema.org, JSON-LD and meta data from three pages.

All examples of Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta

About Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta

Extract JSON-LD, Microdata, RDFa, Open Graph, Twitter cards and SEO meta tags from any web page, sitemap or crawl. One row per page with a normalized primary entity (price, rating, author, address, event, recipe, job, FAQ) and schema validation hints.

Price:

from $0.888 / 1,000 results

Developer:

Querystone

Categories:

SEO tools, Developer tools, AI

Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta pageOutput fieldsPricing