Skip to content
//llms.txt Generator example\\

llms.txt for FastAPI by following links, 8 pages

Builds the file by crawling links two levels deep.

Updated October 21, 2026

Input

The input this example runs llms.txt Generator with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

WebsitesstartUrls
https://fastapi.tiangolo.com/
Max pages per sitemaxPagesPerSite
8
Use the sitemapuseSitemap
No
Max link depthmaxDepth
2
.json
{
  "startUrls": [
    "https://fastapi.tiangolo.com/"
  ],
  "maxPagesPerSite": 8,
  "useSitemap": false,
  "maxDepth": 2
}

The internet is full of data.
Start owning yours.

Scrape.ly gives you the infrastructure, the tooling, and the team to extract, process, and operationalize web data at any scale. Setup takes minutes. The advantage lasts forever.

No credit card. No setup calls.