//llms.txt Generator example\\
llms.txt for Requests docs, 8 pages
A link index file without full page text.
Updated October 21, 2026
Input
The input this example runs llms.txt Generator with. “Try this input” opens it in the console, where you can run it as-is or change any field first.
- WebsitesstartUrls
- https://docs.python-requests.org/
- Max pages per sitemaxPagesPerSite
- 8
- Also create llms-full.txtincludeFullText
- No
.json
{
"startUrls": [
"https://docs.python-requests.org/"
],
"maxPagesPerSite": 8,
"includeFullText": false
}The internet is full of data.
Start owning yours.
Scrape.ly gives you the infrastructure, the tooling, and the team to extract, process, and operationalize web data at any scale. Setup takes minutes. The advantage lasts forever.
No credit card. No setup calls.
The web's data, in your hands.
Powered by Evomi infrastructure.
Powered by Evomi infrastructure.
© 2026 TeraShift GmbH
All services online