Crawlee site via sitemap, 5 pages

Input

The input this example runs Website Content Crawler with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

Start URLsstartUrls

https://crawlee.dev/

Max pagesmaxCrawlPages

5

Max resultsmaxResults

5

Load URLs from SitemapsuseSitemaps

Yes

HTML transformerhtmlTransformer

Defuddle

{
  "startUrls": [
    {
      "url": "https://crawlee.dev/"
    }
  ],
  "useSitemaps": true,
  "htmlTransformer": "defuddle",
  "maxCrawlPages": 5,
  "maxResults": 5
}