Save scraped data to Dropbox

Saves the dataset of each successful run as a file in your Dropbox. You connect your Dropbox once; Scrape.ly only gets its own folder, Apps/Scrape.ly, and can't see or change anything else in your Dropbox.

Connect Dropbox

1. In the dashboard, open Settings → Connections and click Connect account next to Dropbox (or Connect Dropbox in the automation form).
2. Sign in to Dropbox and click Allow.

Dropbox creates the Apps/Scrape.ly folder the first time a file is saved. Scrape.ly can only write files into that folder and read their names; it never reads, changes or deletes your other files. You stay connected: the sign-in renews itself. Disconnect removes the connection and tells Dropbox to remove Scrape.ly's access; files already saved stay in your Dropbox, and Dropbox automations stop until you connect again.

Save results after each run

1. Click New automation, then Or create manually. Under Send, click Dropbox (on an Actor's Automations tab the Actor is already chosen). If Dropbox isn't connected yet, click Connect Dropbox.
2. Choose what happens On each run:
   • New file per run (per-run, the default): Apps/Scrape.ly/<folder>/<actor-name>/<run-id>.<format>.
   • Update one file (overwrite): Apps/Scrape.ly/<folder>/<actor-name>.<format> is replaced each run. Dropbox's version history keeps the earlier ones.
3. Optionally set a Folder inside Apps/Scrape.ly (empty saves into Apps/Scrape.ly itself), the File format (JSON, JSONL or CSV) and Max items per run (1 to 100,000, default 1,000).
4. Save and send a test. A scrapely-test.txt file appears in the folder.

In the automation editor, add Dropbox as a delivery to save the results of several Actors, after filters and an AI step. The file is named after the automation instead of the Actor.

When it saves: only for succeeded runs, and only when the run returned items. A file can be at most 25 MB; lower Max items per run if a run is bigger. The file has the same content as downloading the dataset in that format.

Limits: each Dropbox automation of this kind saves at most 30 times an hour, and an account at most 500 exports a day (Google Sheets, S3, GitHub, Airtable, HubSpot, Notion, and Dropbox together). If Dropbox isn't connected, the connection was removed in Dropbox, or the Dropbox is full, the delivery history on the automation's page says so.

API

A webhook with a dropbox notification. Only ACTOR.RUN.SUCCEEDED is allowed, and Dropbox must be connected in the dashboard first.

curl -X POST https://api.scrape.ly/v2/webhooks \
  -H "Authorization: Bearer $SCRAPELY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "eventTypes": ["ACTOR.RUN.SUCCEEDED"],
    "condition": { "actorId": "YOUR_ACTOR_ID" },
    "description": "Results to Dropbox",
    "notification": {
      "channel": "dropbox",
      "folder": "exports",
      "fileMode": "per-run",
      "format": "csv",
      "maxItems": 1000
    }
  }'

All fields but channel are optional. Responses carry notification.dropboxSettings with folder, fileMode, format and maxItems, and connected says whether Dropbox is still connected. In an automation, use a delivery with "channel": "dropbox" and the same fields.

Scrape.ly uses the Dropbox API; it is not made or endorsed by Dropbox.

FAQ

Can Scrape.ly see the other files in my Dropbox?

No. It only gets its own folder, Apps/Scrape.ly, where it can write files and read their names. It never reads, changes or deletes anything else in your Dropbox.

Which file formats can I save scraped data in?

JSON, JSONL or CSV, with the same content as downloading the dataset in that format. A file can be at most 25 MB, so lower Max items per run (1 to 100,000, default 1,000) for bigger runs.

Can I keep one file up to date instead of adding a file per run?

Yes. Choose Update one file and each run replaces Apps/Scrape.ly/<folder>/<actor-name>.<format>. Dropbox's version history keeps the earlier versions.