Skip to content

SPIP Site Finder

Try for free

Discover websites built with the SPIP CMS under any domain ending (sch.id, ac.id, edu, fr...) and verify each one: SPIP version and evidence, page title, and whether it is a university, school, madrasah or other education site. One row per domain.

🔎 SPIP Site Finder

Discover websites built with the SPIP CMS under any domain ending (sch.id, ac.id, edu, fr, ac-rennes.fr...) and get one verified row per domain: the SPIP version and the evidence, the page title and whether the site is a university, school, madrasah or another education site. No login, no API key.

✨ Why use SPIP Site Finder?

  • 🧭 Discovery, not just detection — scans the public Common Crawl web index for URLs only SPIP produces (spip.php, /ecrire/) and searches the web for the SPIP footer credit, so you get domains you did not know about.
  • ✅ Every site verified live — each candidate's home page is opened and checked for the Composed-By: SPIP header, the SPIP generator tag and SPIP markup (the site's own spip.php links, local/cache-* and squelettes paths, spip_* classes). Without the header or the generator tag, at least two markup signals are needed, one of them a path only a SPIP install serves. Sites that moved to another CMS are left out.
  • 🎓 Education category — universities, schools, madrasahs and Islamic schools, education offices and other learning sites, judged from the domain (sch.id, ac.id, edu, French academy domains) and the page title and description.
  • 🧾 Readable tech signature — e.g. SPIP 4.4.30 (Composed-By header, generator meta tag, spip.php links).
  • 🔁 One row per domain — candidates are deduplicated per host within the run.

🎯 Use cases

  • 🏫 Build a list of school, madrasah and university websites running SPIP in a country (e.g. Indonesian .sch.id and .ac.id domains).
  • 🧑‍💻 Find SPIP sites for migration, hosting, maintenance or plugin offers.
  • 🔐 Inventory the SPIP versions running under a domain you look after, to plan upgrades.
  • 📊 Research how widely SPIP is used in education in a region.

🚀 How to use

  1. Add one or more domain suffixes, e.g. sch.id, ac.id, edu or ac-rennes.fr.
  2. Optionally add your own web search queries (e.g. "Propulsé par SPIP" école) or domains to check.
  3. Set Max SPIP sites (0 = no limit) and keep Education sites only on or turn it off to get every SPIP site.
  4. Run, then export the results as JSON, CSV or Excel, or read them through the API.

📥 Input

FieldWhat it does
domainSuffixesDomain endings to scan, e.g. ["sch.id", "ac.id", "edu"]
searchQueriesOptional Google searches whose result sites are checked (when suffixes are set, only result sites under them are kept)
domainsOptional domains or URLs you already have, checked the same way (a URL with a path is checked too, for SPIP in a sub-folder)
maxResultsStop after this many matching SPIP sites (0 = no limit)
educationOnlySave only education sites (default on)
educationCategoriesOptional subset: university, school, madrasah, education_office, education_other
useCommonCrawlScan the Common Crawl index for each suffix (default on)
crawlsPerSuffixHow many monthly Common Crawl crawls to scan per suffix (default 1)
fingerprintSearchAdd web searches for SPIP fingerprints per suffix (default on)
searchPagesPerQueryGoogle result pages read per query (default 2)
searchCountry, searchLanguageOptional country and interface language for the web searches, e.g. id
{
  "domainSuffixes": ["ac-rennes.fr", "ac-nantes.fr"],
  "maxResults": 100,
  "educationOnly": true
}

Scanning the large Indonesian suffixes in the index takes long (measured 17-56 seconds per block: sch.id roughly 1-3 hours, ac.id roughly 3-9 hours): give such runs a long timeout, or split them over several runs.

📤 Output

FieldDescription
domainThe site's host name (without www)
urlThe page where SPIP was confirmed
titleThe home page title
cmsSignatureSPIP version and the evidence found
spipVersionSPIP version when the site shows it
spipConfidenceconfirmed (SPIP header or generator tag) or strong (two or more SPIP markup signals, one of them a SPIP-only path)
spipSignalsEvery piece of SPIP evidence on the page
educationCategoryuniversity, school, madrasah, education_office, education_other, or empty
educationEvidenceWhat the category is based on (a domain ending or a word in the title)
description, languageThe page's meta description and language
discoveredBy, discoveryUrlHow the site was found (common-crawl, web-search, input) and the URL that led to it
httpStatusThe HTTP status of the page checked
notee.g. when the site was read over http because https did not work
checkedAtWhen the site was checked
{
  "domain": "lycee-vauban-brest.fr",
  "url": "https://www.lycee-vauban-brest.fr/",
  "title": "Lycée VAUBAN",
  "cmsSignature": "SPIP 4.4.30 (Composed-By header, X-Spip-Cache header, generator meta tag, spip.php links, SPIP CSS classes, SPIP logo files, Powered by SPIP text)",
  "spipVersion": "4.4.30",
  "spipConfidence": "confirmed",
  "educationCategory": "school",
  "educationEvidence": "Lycée",
  "language": "fr",
  "discoveredBy": "web-search",
  "discoveryUrl": "https://www.lycee-vauban-brest.fr/phare-un-programme-de-lutte-contre-le-harcelement-a-l-ecole.html",
  "checkedAt": "2026-11-16T14:00:00+00:00"
}

❓ FAQ

Do I need a login or an API key? No. The actor reads public web pages and the public Common Crawl index.

How many sites will I get? As many as exist and can be reached: discovery depends on what the web index and search engines hold for your suffixes. SPIP is widespread in France and francophone education; under some suffixes (for example Indonesian school domains) only a few SPIP sites may exist. The run summary says how many candidates were checked and how many run SPIP.

Why was a site left out? It no longer runs SPIP, did not answer, showed only one weak SPIP hint, or has no education content while Education sites only is on.

How is the education category decided? From the domain ending (sch.id = school, ac.id and edu = university, French academy domains), then from words in the page title and description in English, French, Indonesian, Spanish and Portuguese (e.g. sekolah, madrasah, universitas, lycée, collège, école). It is a best guess from public text.

Can I schedule it or use the API? Yes. Schedule runs in the console or start them through the API and read the dataset as JSON or CSV.

⚠️ Limits

  • Discovery covers what Common Crawl and Google hold; a SPIP site neither has seen cannot be discovered (add it under Domains to check).
  • The Common Crawl index answers slowly (often 10-25 seconds per index block, and it limits parallel requests). Small suffixes such as one French academy take minutes; large ones take hours (ac.id about 570 blocks, sch.id about 175, edu about 6,800 per crawl, at 17-56 seconds per block). Set Max SPIP sites or a run timeout that fits: the run stops shortly before its timeout, keeps every site found and says how much of the index it read.
  • Sites that hide every SPIP trace (no header, no generator tag, rewritten URLs and custom templates) are not counted.
  • The education category is inferred from public text and domain names, not from an official register.
//From the blog\\

Latest articles

All articles

The internet is full of data.
Start owning yours.

Scrape.ly gives you the infrastructure, the tooling, and the team to extract, process, and operationalize web data at any scale. Setup takes minutes.

No credit card. No setup calls.