Removing duplicate images (deduplication) - calculating "overlap" of images

Posted by jotango on Server Fault See other posts from Server Fault or by jotango
Published on 2010-05-06T09:33:26Z Indexed on 2010/05/06 9:38 UTC
Read the original article Hit count: 806

Filed under:

I have a ton of product images on our file system. Our code removes 100% identical images (or does not allow them to be uploaded). However our sellers often upload items pictures which are very similar, but not exactly. They could have more whitespace, a worse quality (compression), a different size etc.

Is there any way I can calculate the degree of overlap between two images, to flag ones for deletion? Kind of like a Levenshtein distance between two images...

Any pointers would be very cool. Thanks!

Related posts about images

Removing duplicate images (deduplication) - calculating "overlap" of images

as seen on Server Fault - Search for 'Server Fault'
Hello, I have a ton of product images on our file system. Our code removes 100% identical images (or does not allow them to be uploaded). However our sellers often upload items pictures which are very similar, but not exactly. They could have more whitespace, a worse quality (compression), a different… >>> More
How can I center XHTML content with CSS?

as seen on Stack Overflow - Search for 'Stack Overflow'
so I recently converted a website of mine from a table content format to a div content format. Table format Version: Table version of the website: here. Table version style CSS: body { width: 1020px; margin: 0 auto; background-image: url(images/bg.png); } .logo{ width:301px; … >>> More
CHAT ROOMs 7 by 6

as seen on Stack Overflow - Search for 'Stack Overflow'
I am looking for chatroom on one page with 7 loggedin users and 6+rows for say 42 users.these users will keep on adding wthnew users.Need urgent help.A PRETTY UNUSUAL Q FOR MOST OF U.What is MORE REQ new features: Usernames are unique to users currently chatting You can see a "currently chatting"… >>> More
Why can't I build Deluge?

as seen on Super User - Search for 'Super User'
Deluge is a BitTorrent Client. I am trying to build it from source, since I don't have privilege to install it as root. I am using python setup.py build. But, it failed following message, why? copying deluge/ui/web/themes/images/gray/slider/slider-v-thumb.png -> build/lib.linux-x86_64-2.4/deluge/ui/web/themes/images/gray/slider copying… >>> More
Warping Images using cvWarpPerspective Results in Some Parts of the images out of the viewable area

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am trying to stich two images together. In order to do so I extracted sift features and find matches on the two images using this C implementation. http://web.engr.oregonstate.edu/~hess/index.html After that I found the homography matrix using the matched points. http://www.ics.forth… >>> More

Developer IT