Skip to content
//llms.txt Generator example\\

llms.txt for Requests docs, 8 pages

A link index file without full page text.

Updated October 21, 2026

Input

The input this example runs llms.txt Generator with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

WebsitesstartUrls
https://docs.python-requests.org/
Max pages per sitemaxPagesPerSite
8
Also create llms-full.txtincludeFullText
No
.json
{
  "startUrls": [
    "https://docs.python-requests.org/"
  ],
  "maxPagesPerSite": 8,
  "includeFullText": false
}

The internet is full of data.
Start owning yours.

Scrape.ly gives you the infrastructure, the tooling, and the team to extract, process, and operationalize web data at any scale. Setup takes minutes. The advantage lasts forever.

No credit card. No setup calls.