Scalable (half-million files) version control system
- by hashable
We use SVN for our source-code revision control and are experimenting using it for non-source-code files.
We are working with a large set (300-500k) of short (1-4kB) text files that will be updated on a regular basis and need to version control it. We tried using SVN in flat-file mode and it is struggling to handle the first commit (500k files checked in) taking about 36 hours.
On a daily basis, we need the system to be able to handle 10k modified files per commit transaction in a short time (<5 min).
My questions:
Is SVN the right solution for my purpose. The initial speed seems too slow for practical use.
If Yes, is there a particular svn server implementation that is fast? (We are currently using the gnu/linux default svn server and command line client.)
If No, what are the best f/oss/commercial alternatives
Thanks
