Convert filenames to their checksum before saving to prevent duplicates. Is is a smart thing to do?

Posted by Xananax on Programmers See other posts from Programmers or by Xananax
Published on 2011-06-25T01:10:04Z Indexed on 2011/06/25 8:30 UTC
Read the original article Hit count: 372

Filed under:

file-structure

|

hashing

TL;DR:what the title says

I am developing some sort of image board in PHP. I was thinking of changing each image's filename to it's checksum prior to saving it. This way, I might be able to prevent duplicates.
I know this wouldn't work for two images that are the same but differ in size or level of compression or whatnot, but this method would allow for an early check.
What bugs me is that I never saw this method implemented anywhere, so I was wondering if there is a catch to it. Maybe it is just more efficient to keep the original filename and store the hash in DB? Maybe the whole method is just not useful and my question is moot?
What do you think?

On a side note, I don't really get how hashes are calculated so I was wondering, if my first question checks out, if it would be possible to calculate the likeness that two images are similar by comparing hashes (levenshtein or something of the sort).

© Programmers or respective owner

Related posts about file-structure

How to avoid apache2 revealing hidden directory and/or file structure

as seen on Server Fault - Search for 'Server Fault'
When someone fetches a denied URL that exists, he gets: Forbidden You don't have permission to access /admin/admin.php on this server. Apache/2.2.8 (Ubuntu) PHP/5.2.4-2ubuntu5.9 with Suhosin-Patch Server When someone goes to a URL that does not exist he will get: Not Found The requested URL… >>> More
Linux file structure

as seen on Super User - Search for 'Super User'
ok. I asked this question earlier(as part of another question) and got no response - so here it is again: what i the recommened directory for me to store the following: 1). my apps 2). development tools (C++ tools) 3). AMP applications for LAMP stack (Apache, MySQL, PHP) 4). files for websites that… >>> More
ASP.Net MVC View and Controller file structure

as seen on Stack Overflow - Search for 'Stack Overflow'
I am very confused the View and corresponding controller has to be set in MVC 1.0 project structure. Currently in a default application we have About.aspx page under Home folder and all the controller action is handled in HomeController. This controller mixes up Home action and About action. It makes… >>> More
Dynamically create hierachical tableview from file structure

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I have a directory structure of directories and files that I want to render as a tableview in an iphone app. I'd rather have this generated dynamically rather than have to maintain a XML PLIST or whatever. i.e. replicate the Explorer functionality in windows where a user can traverse the structure… >>> More
reference suggestion in latex windows (multi-file structure)

as seen on Stack Overflow - Search for 'Stack Overflow'
There is some editor of latex that managed the labels for a multifile document?. I tried with TexMaker and LED, and they offers me suggestions about the labels present in the actual document and in the "Master" document but not the labels present in other files of the structure. I made a script to… >>> More

Related posts about hashing

Is hashing of just "username + password" as safe as salted hashing

as seen on Programmers - Search for 'Programmers'
I want to hash "user + password". EDIT: prehashing "user" would be an improvement, so my question is also for hashing "hash(user) + password". If cross-site same user is a problem then the hashing changed to hashing "hash(serviceName + user) + password" From what I read about salted hash, using… >>> More
Index Hashing vs Normal Hashing

as seen on Stack Overflow - Search for 'Stack Overflow'
What is index hashing ? What are its advantages over regular hashing techniques ? >>> More
Secure hash and salt for PHP passwords

as seen on Stack Overflow - Search for 'Stack Overflow'
It is currently said that MD5 is partially unsafe. Taking this into consideration, I'd like to know which mechanism to use for password protection. Is “double hashing” a password less secure than just hashing it once? Suggests that hashing multiple times may be a good idea. How to implement password… >>> More
SHA512 vs. Blowfish and Bcrypt

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm looking at hashing algorithms, but couldn't find an answer. Bcrypt uses Blowfish Blowfish is better than MD5 Q: but is Blowfish better than SHA512? Thanks.. Update: I want to clarify that I understand the difference between hashing and encryption. What prompted me to ask the question… >>> More
Do encryption algorithms require an internal hashing algorithm?

as seen on Stack Overflow - Search for 'Stack Overflow'
When I use C# to implement the AES symmetric encryption cipher, I noticed: PasswordDeriveBytes derivedPassword = new PasswordDeriveBytes(password, saltBytesArray, hashAlgorithmName, numPasswordIterations); Why do I need to use a hashing algorithm for AES encryption? Aren't they separate? Or is… >>> More