What is the fastest hash algorithm to check if two files are equal?

Posted by eflles on Stack Overflow See other posts from Stack Overflow or by eflles
Published on 2009-11-19T07:52:54Z Indexed on 2010/05/17 4:30 UTC
Read the original article Hit count: 204

Filed under:

hashing

|

files

|

crc

What is the fastest way to create a hash function which will be used to check if two files are equal?

Security is not very important.

Edit: I am sending a file over a network connection, and will be sure that the file on both sides are equal

© Stack Overflow or respective owner

Related posts about hashing

Is hashing of just "username + password" as safe as salted hashing

as seen on Programmers - Search for 'Programmers'
I want to hash "user + password". EDIT: prehashing "user" would be an improvement, so my question is also for hashing "hash(user) + password". If cross-site same user is a problem then the hashing changed to hashing "hash(serviceName + user) + password" From what I read about salted hash, using… >>> More
Index Hashing vs Normal Hashing

as seen on Stack Overflow - Search for 'Stack Overflow'
What is index hashing ? What are its advantages over regular hashing techniques ? >>> More
Secure hash and salt for PHP passwords

as seen on Stack Overflow - Search for 'Stack Overflow'
It is currently said that MD5 is partially unsafe. Taking this into consideration, I'd like to know which mechanism to use for password protection. Is “double hashing” a password less secure than just hashing it once? Suggests that hashing multiple times may be a good idea. How to implement password… >>> More
SHA512 vs. Blowfish and Bcrypt

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm looking at hashing algorithms, but couldn't find an answer. Bcrypt uses Blowfish Blowfish is better than MD5 Q: but is Blowfish better than SHA512? Thanks.. Update: I want to clarify that I understand the difference between hashing and encryption. What prompted me to ask the question… >>> More
Do encryption algorithms require an internal hashing algorithm?

as seen on Stack Overflow - Search for 'Stack Overflow'
When I use C# to implement the AES symmetric encryption cipher, I noticed: PasswordDeriveBytes derivedPassword = new PasswordDeriveBytes(password, saltBytesArray, hashAlgorithmName, numPasswordIterations); Why do I need to use a hashing algorithm for AES encryption? Aren't they separate? Or is… >>> More

Related posts about files

Unzip individual files from multiple zip files and extract those individual files to home directory

as seen on Super User - Search for 'Super User'
I would like to unzip individual files. These files have a .txt extension. These files also live within multiple zipped files. Here is the command I'm trying to use. unzip -jn /path/to/zipped/files/zipArchiveFile2011\*.zip /path/to/specific/individual/files/myfiles2011*.txt -d /path/to/home/directory/for/extract/ From… >>> More
Storing image files, psd files, ai files, flash in subversion

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, Can I store large amounts of image files in subversion. My designers usually create these designs and store them anywhere on their pc and there's no system. Can I store the files in an svn repository. That way I can also protect my data against unauthorized access and its also easier to archive… >>> More
Copy files in Linux, avoid the copy if files do exist in destination

as seen on Super User - Search for 'Super User'
Hi, I need to copy a /home/user folder from one hardisk to another one. It has 100000 files and around 10G size. I use cp -r /origin /destination sometines I get some errors due to broken links, permissions and so on. So I fix the error, and need to start again the copy. I wonder how could… >>> More
Best way to convert pdf files to tiff files

as seen on Stack Overflow - Search for 'Stack Overflow'
I have around 1000 pdf filesand I need to convert them to 300 dpi tiff files. What is the best way to do this? If there is an SDK or something or a tool that can be scripted that would be ideal. >>> More
what is the difference between ELF files and bin files

as seen on Stack Overflow - Search for 'Stack Overflow'
The final images produced by compliers contain both bin file and extended loader format ELf file ,what is the difference between too , especially the utility of ELF file. >>> More