Crawl a bookstore 2 levels deep, 15 pages

Input

The input this example runs Structured Data Extractor – Schema.org, JSON-LD, OpenGraph & Meta with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

Start URLsstartUrls

https://books.toscrape.com/

Max discovered pagesmaxCrawlPages

15

Link crawl depthcrawlDepth

2

Only pages with structured dataonlyPagesWithStructuredData

No

Output rowsoutputMode

One row per page

Data to extractsyntaxes

json-ld, microdata, rdfa, opengraph, twitter, meta

Validation hintsvalidateSchema

Yes

Include raw markup dataincludeRawData

Yes

Include headings outlineincludeHeadings

Yes

Max parallel requestsmaxConcurrency

16

Page timeout (seconds)requestTimeoutSecs

20

{
  "startUrls": [
    "https://books.toscrape.com/"
  ],
  "crawlDepth": 2,
  "maxCrawlPages": 15,
  "onlyPagesWithStructuredData": false,
  "outputMode": "pages",
  "syntaxes": [
    "json-ld",
    "microdata",
    "rdfa",
    "opengraph",
    "twitter",
    "meta"
  ],
  "validateSchema": true,
  "includeRawData": true,
  "includeHeadings": true,
  "maxConcurrency": 16,
  "requestTimeoutSecs": 20
}