Save scraped data to OneDrive

Saves the dataset of each successful run as a file in your OneDrive. You connect your Microsoft account once; Scrape.ly only gets its own folder, Apps/Scrape.ly, and can't see or change anything else in your OneDrive.

Connect OneDrive

1. In the dashboard, open Settings → Connections and click Connect account next to OneDrive (or Connect OneDrive in the automation form).
2. Sign in with your Microsoft account and click Accept.

Personal Microsoft accounts and work or school accounts both work. Some work or school accounts only let you connect once your IT admin has approved Scrape.ly; Microsoft shows a message saying so when that's the case.

OneDrive creates the Apps/Scrape.ly folder the first time a file is saved. Scrape.ly can only access that folder; it never reads, changes or deletes your other files. You stay connected: the sign-in renews itself. Disconnect removes the stored sign-in; files already saved stay in your OneDrive, and OneDrive automations stop until you connect again.

Save results after each run

1. Click New automation, then Or create manually. Under Send, click OneDrive (on an Actor's Automations tab the Actor is already chosen). If OneDrive isn't connected yet, click Connect OneDrive.
2. Choose what happens On each run:
   • New file per run (per-run, the default): Apps/Scrape.ly/<folder>/<actor-name>/<run-id>.<format>.
   • Update one file (overwrite): Apps/Scrape.ly/<folder>/<actor-name>.<format> is replaced each run. OneDrive's version history keeps the earlier ones.
3. Optionally set a Folder inside Apps/Scrape.ly (empty saves into Apps/Scrape.ly itself), the File format (JSON, JSONL or CSV) and Max items per run (1 to 100,000, default 1,000).
4. Save and send a test. A scrapely-test.txt file appears in the folder.

In the automation editor, add OneDrive as a delivery to save the results of several Actors, after filters and an AI step. The file is named after the automation instead of the Actor.

When it saves: only for succeeded runs, and only when the run returned items. A file can be at most 25 MB; lower Max items per run if a run is bigger. The file has the same content as downloading the dataset in that format.

Limits: each OneDrive automation of this kind saves at most 30 times an hour, and an account at most 500 exports a day (Google Sheets, S3, GitHub, Airtable, HubSpot, Salesforce, Notion, Dropbox, OneDrive, Postgres, Azure Blob, BigQuery, OpenAI Vector Store, and Snowflake together). If OneDrive isn't connected, the access was removed in your Microsoft account, or the OneDrive is full, the delivery history on the automation's page says so.

API

A webhook with a onedrive notification. Only ACTOR.RUN.SUCCEEDED is allowed, and OneDrive must be connected in the dashboard first.

curl -X POST https://api.scrape.ly/v2/webhooks \
  -H "Authorization: Bearer $SCRAPELY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "eventTypes": ["ACTOR.RUN.SUCCEEDED"],
    "condition": { "actorId": "YOUR_ACTOR_ID" },
    "description": "Results to OneDrive",
    "notification": {
      "channel": "onedrive",
      "folder": "exports",
      "fileMode": "per-run",
      "format": "csv",
      "maxItems": 1000
    }
  }'

All fields but channel are optional. Responses carry notification.onedriveSettings with folder, fileMode, format and maxItems, and connected says whether OneDrive is still connected. In an automation, use a delivery with "channel": "onedrive" and the same fields.

Scrape.ly uses the Microsoft Graph API; it is not made or endorsed by Microsoft.

FAQ

Can Scrape.ly see the other files in my OneDrive?

No. It only gets its own folder, Apps/Scrape.ly. It never reads, changes or deletes anything else in your OneDrive.

Does it work with a work or school account?

Yes. Personal Microsoft accounts and work or school accounts both work. If your organization requires admin approval for new apps, ask your IT admin to approve Scrape.ly, then connect again.

Which file formats can I save scraped data in?

JSON, JSONL or CSV, with the same content as downloading the dataset in that format. A file can be at most 25 MB, so lower Max items per run (1 to 100,000, default 1,000) for bigger runs.

Can I keep one file up to date instead of adding a file per run?

Yes. Choose Update one file and each run replaces Apps/Scrape.ly/<folder>/<actor-name>.<format>. OneDrive's version history keeps the earlier versions.