Fast duplicate check (hashes only)

What this example returns

The dataset’s “Duplicates and matches” view shows 15 columns: #, Image, Verdict, Group, Keep, Duplicate of, Compared with, Similarity, Hash distance, Near duplicate, Similar, Width, Height, Custom ID, and Error. See every output field.

What each setting does

The input this example runs Duplicate Image Finder & Image Similarity with. “Try this input” opens it in the console, where you can run it as-is or change any field first.

Images imageUrls

https://upload.wikimedia.org/wikipedia/commons/thumb/9/90/Labrador_Retriever_portrait.jpg/960px-Labrador_Retriever_portrait.jpg, https://upload.wikimedia.org/wikipedia/commons/thumb/9/90/Labrador_Retriever_portrait.jpg/250px-Labrador_Retriever_portrait.jpg, https://upload.wikimedia.org/wikipedia/co…

Links to the images, one per line: JPEG, PNG, WebP, GIF, AVIF, HEIC, TIFF or BMP, up to 100 MB each. With no reference image, every image is checked against all the others and duplicates are grouped. With a reference image, every image is compared with it. Google Drive, Dropbox and GitHub share links are turned into…

What to compare comparisonMode

Duplicate hashes only (fastest)

Both: a visual similarity score from a vision model plus perceptual hashes that prove whether two files are the same picture (resized, recompressed or lightly edited). Hashes only: duplicate detection without the model, the fastest. Visual similarity only: the model score without hashes.

Default: Visual similarity + duplicate hashes → this example uses Duplicate hashes only (fastest)

Duplicate distance (0 to 64) duplicateDistance

10

Two images are duplicates when their perceptual hashes differ in at most this many of 64 bits. 8 catches resized, recompressed and lightly edited copies; 0 accepts only the same picture structure; 12 also catches small watermarks and stronger edits.

Default: 8 → this example uses 10

{
  "imageUrls": [
    "https://upload.wikimedia.org/wikipedia/commons/thumb/9/90/Labrador_Retriever_portrait.jpg/960px-Labrador_Retriever_portrait.jpg",
    "https://upload.wikimedia.org/wikipedia/commons/thumb/9/90/Labrador_Retriever_portrait.jpg/250px-Labrador_Retriever_portrait.jpg",
    "https://upload.wikimedia.org/wikipedia/commons/9/9a/Gull_portrait_ca_usa.jpg",
    "https://upload.wikimedia.org/wikipedia/commons/thumb/9/9a/Gull_portrait_ca_usa.jpg/330px-Gull_portrait_ca_usa.jpg",
    "https://upload.wikimedia.org/wikipedia/commons/thumb/9/9a/Gull_portrait_ca_usa.jpg/330px-Gull_portrait_ca_usa.jpg",
    "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABgAAAAYCAIAAABvFaqvAAAAPUlEQVR42mNkYNDgYmBARQswRBIIqmFh4GKgChg1iCiDFmAIJmCIEFYzGtj0NYicOMJUMxrYo3lt1CC8AAAqbAnyMK5DJwAAAABJRU5ErkJggg==",
    "https://example.com/missing-photo.jpg",
    "https://en.wikipedia.org/wiki/Cat",
    "https://upload.wikimedia.org/wikipedia/commons/0/02/SVG_logo.svg"
  ],
  "comparisonMode": "hash",
  "duplicateDistance": 10
}

What it costs

You pay for the events the actor reports, such as each result or page it produces. Platform usage is included in the event prices: compute, proxies, browser and storage cost nothing extra.

• Image resultfrom $0.00034One result row: an image checked against the other images of the list (its duplicate group, closest match and scores), or one image compared with one reference image. Images that cannot be read get free error rows.

Full pricing

When to use this example

From the Duplicate Image Finder & Image Similarity readme:

Other ways to run Duplicate Image Finder & Image Similarity

• Find duplicate photos in a listGroups resized copies of the same photo and marks the largest copy to keep.
• Compare images with reference photosScores every image against your originals and flags copies.
• Group visually similar imagesGroups different photos of the same subject by visual similarity.

All examples of Duplicate Image Finder & Image Similarity

About Duplicate Image Finder & Image Similarity

Find duplicate and near-duplicate images in a list of links or a dataset, or compare images with your reference images. Perceptual hashes (pHash, dHash) catch resized and recompressed copies; a vision model scores visual similarity. Duplicate groups, the copy to keep, and a verdict per image.

Price:

from $0.34 / 1,000 results

Developer:

Echofield

Categories:

Developer tools, AI, E-commerce

Duplicate Image Finder & Image Similarity pageOutput fieldsPricing