What is the fastest MD5 sum calculator?

Posted by netvope on Super User See other posts from Super User or by netvope
Published on 2010-04-01T22:19:31Z Indexed on 2010/04/01 22:23 UTC
Read the original article Hit count: 607

Filed under:

md5sum

|

md5

|

ubuntu

|

hash

I tested the speed of md5sum on a few Ubuntu 8.04 servers

Pentium III 700 MHz: 52 MB/s
Atom 1.6 GHz, 32-bit: 119 MB/s
Core 2 (Yorkfield) 2.5GHz, 32-bit: 194 MB/s
Core 2 (Yorkfield) 2.5GHz, 64-bit: 222 MB/s

Then I downloaded a tool (by apt-get install) called md5deep and found that it's roughly 20% faster (as tested on the 32-bit Core 2 server). This makes me feel that the "vanilla" md5sum included in Ubuntu isn't the fastest one.

Questions:

Other than md5deep, are you aware of any MD5 calculators that are potentially faster than md5sum? (Answers for software from other OS are also welcomed.)
If I want to compile md5sum myself, where can I download the source? What compiler options would you suggest for the Core 2 server? (note: gcc 4.2.4 in Ubuntu 8.04 does not seem to support -march=core2)

© Super User or respective owner

Related posts about md5sum

How do I compare the md5sum of a file with the md5 file (that was available to download with the file)?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Images are available for a distro on http://livedistro.org/gnulinux/israel-remix-team-mint-12. I want to use the 32-bit version. I have downloaded the ISO file for the 32-bit version (customdist.iso). I have downloaded the md5 file for the ISO file (customdist.iso.md5). I want to calculate the md5sum… >>> More
What is the fastest MD5 sum calculator?

as seen on Super User - Search for 'Super User'
I tested the speed of md5sum on a few Ubuntu 8.04 servers Pentium III 700 MHz: 52 MB/s Atom 1.6 GHz, 32-bit: 119 MB/s Core 2 (Yorkfield) 2.5GHz, 32-bit: 194 MB/s Core 2 (Yorkfield) 2.5GHz, 64-bit: 222 MB/s Then I downloaded a tool (by apt-get install) called md5deep and found that it's roughly… >>> More
md5sum repeatedly gives different checksum for same file on same machine

as seen on Server Fault - Search for 'Server Fault'
I have a very small and quite old hard drive disk, about 32G. On to this disk I have copied a largish tar file, about 5G. When I run md5sum to generate a checksum on this file I repeatedly get different results (on the same machine and the same file). This obviously should not happen. If I repeat… >>> More
Update failure: failed md5sum validation: sys.vgz

as seen on Server Fault - Search for 'Server Fault'
LS, I have ESXi 4, with all the 2009 updates installed. When i try to update the last firmware update, i receive the following error: Copy of /bootbank/sys.vgz to /tmp/stage/firmware/bank/sys.vgz failed md5sum validation (8:02:31:29.332 cpu1:1787979) warning 20-Jan-10 9:42:02 PM I updated the vmware-tools… >>> More
md5sum via right click in ubuntu

as seen on Super User - Search for 'Super User'
Is there an extension or script to calculate a file's md5 hash using the right click of the mouse in Ubuntu ? >>> More

Related posts about md5

Getting Oracle's MD5 to match PHP's MD5

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi all, I'm trying to compare an MD5 checksum generated by PHP to one generated by Oracle 10g. However it seems I'm comparing apples to oranges. Here's what I did to test the comparison: //md5 tests //php md5 print md5('testingthemd5function'); print '<br/><br/>'; //oracle… >>> More
Python: How to display the calculated MD5 value in my browser?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, I was given this Python code that would calculate an MD5 value for any phrase: import md5 md5.new("Nobody inspects the spammish repetition").digest() (The phrase here is: "Nobody inspects the spammish repetition") What I want to do is display this value in my browser. How do I do it in… >>> More
How are hash functions like MD5 unique?

as seen on Stack Overflow - Search for 'Stack Overflow'
Im aware that MD5 has had some collisions but this is more of a high level question about hashing functions. If MD5 hashes any arbitrary string into a 32-digit hex value, then according to the Pigeonhole Principle surely this can not be unique as there are more unique arbitrary strings than there… >>> More
Converting a md5 hash byte array to a string

as seen on Stack Overflow - Search for 'Stack Overflow'
How can I convert the hashed result, which a byte array, to a string? byte[] bytePassword = Encoding.UTF8.GetBytes(password); using (MD5 md5 = MD5.Create()) { byte[] byteHashedPassword = md5.ComputeHash(bytePassword); } So I need to convert… >>> More
How do I compare the md5sum of a file with the md5 file (that was available to download with the file)?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
Images are available for a distro on http://livedistro.org/gnulinux/israel-remix-team-mint-12. I want to use the 32-bit version. I have downloaded the ISO file for the 32-bit version (customdist.iso). I have downloaded the md5 file for the ISO file (customdist.iso.md5). I want to calculate the md5sum… >>> More