Articles from The Verge's feeds, 5 per feed

What this example returns

The dataset’s “Full articles” view shows 7 columns: Title, Link, Published, Article words, Article (Markdown), Article (text), and Article note. See every output field.

What each setting does

The input this example runs RSS Feed Scraper with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

Feed or website URLs urls

https://www.theverge.com

RSS, Atom or JSON Feed URLs, one per line. You can also paste a normal website or blog URL: its feeds are discovered automatically.

Max items per feed maxItemsPerFeed

5

Return at most this many items from each feed, newest first as the feed lists them. 0 means every item in the feed.

Default: 20 → this example uses 5

Discover feeds on websites discoverFeeds

Yes

When a URL is a web page, find the feeds it advertises (and try common paths like /feed and /rss.xml).

Article format articleFormat

Plain text

Format of the full article text.

Default: Markdown → this example uses Plain text

{
  "urls": [
    "https://www.theverge.com"
  ],
  "maxItemsPerFeed": 5,
  "discoverFeeds": true,
  "articleFormat": "text"
}

What it costs

You pay for the events the actor reports, such as each result or page it produces. Platform usage is included in the event prices: compute, proxies, browser and storage cost nothing extra.

• Full article extracted$0.0012Charged for each item whose full article text was extracted (only with Get full article text on). Articles that fail to load are free.
• Feed read$0.0018Charged once for each feed read, with all its items up to your limit. Feeds with no new items after your filters, invalid URLs and failed feeds are free.

Full pricing

When to use this example

From the RSS Feed Scraper readme:

Other ways to run RSS Feed Scraper

• BBC News and Hacker News articles, 5 per feedFeed items with the full article text in Markdown.
• Find feeds on a website, 5 per feedDiscovers feeds from a homepage and reads a podcast feed.
• Latest headlines from 2 feeds, 10 per feedTitles, links and dates without article content.

All examples of RSS Feed Scraper

About RSS Feed Scraper

Read RSS, Atom and JSON feeds or discover them from any website. Get clean items with dates, authors, images and podcast files, filter by date and keyword, dedupe, and add full article text as Markdown for RAG. No login needed.

Price:

from $1.41 / 1,000 feed reads

Developer:

Querystone

Categories:

AI, News, Developer tools

RSS Feed Scraper pageOutput fieldsPricing