Posts from Astral Codex Ten, 3 posts

What this example returns

This example returns up to 3 posts.

The dataset’s “Posts” view shows 16 columns: Title, URL, Newsletter, Author, Published, Audience, Type, Reactions, Comments, Restacks, Words, Subtitle, Subscribers, Tags, Cover image, and Search query. See every output field.

What each setting does

The input this example runs Substack Scraper with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

Newsletter, post or profile URLs startUrls

https://astralcodexten.substack.com

Substack newsletters (https://name.substack.com, a custom domain like https://www.lennysnewsletter.com, or just the subdomain name), single post URLs (/p/slug), or author profiles (https://substack.com/@handle). Archive and homepage URLs work too.

Max posts per newsletter maxPostsPerNewsletter

3

Newest posts to save from each newsletter or profile. 0 = the whole archive.

Default: 10 → this example uses 3

Max comments per post maxCommentsPerPost

0

Comments (including replies) to keep per post. 0 = all.

Default: 20 → this example uses 0

{
  "startUrls": [
    "https://astralcodexten.substack.com"
  ],
  "maxPostsPerNewsletter": 3,
  "maxCommentsPerPost": 0
}

What it costs

You pay for the events the actor reports, such as each result or page it produces, plus the platform usage of your runs: compute, proxies and storage. Platform usage is typically about $0.112 per 1,000 results.

• Comment$0.0004One comment or reply saved when comments are on.
• Post (metadata)$0.0008One post saved without full content (content turned off, or a paid post with only the public preview).
• Post with full content$0.0015One free Substack post saved with its full HTML and text.

Full pricing

When to use this example

From the Substack Scraper readme:

Other ways to run Substack Scraper

• Noahpinion posts with comments, 3 postsLatest newsletter posts with up to 5 comments each.
• Free climate policy newsletters, 5 resultsNewsletters matching a keyword that are free to read.
• Astral Codex Ten, last 6 months, 5 postsPost titles, dates and links without the full text.

All examples of Substack Scraper

About Substack Scraper

Scrape Substack newsletters, posts and authors without login: titles, full text of free posts, publish dates, reactions, comments with replies, paid/free status, subscriber counts and author info. Search by keyword or paste newsletter, post or profile URLs.

Price:

from $1.20 / 1,000 results

Developer:

Echofield

Categories:

Social media, News, Lead generation

Substack Scraper pageOutput fieldsPricing