Where would an S3 upload speed cap originate?

Posted by CoreyH on Server Fault See other posts from Server Fault or by CoreyH
Published on 2010-05-12T17:27:03Z Indexed on 2010/05/12 17:34 UTC
Read the original article Hit count: 250

I do a ton of uploading to S3 and am experiencing capped speeds and I can't quite figure out how to address it.

The setup: Windows Server 2008 R2 x64, external HD, using a Java based upload tool called Jsh3ll and custom VBS scripts to kick the jobs off.

Running one process at a time, I am always limited to about 4mbps. I have FiOS at 35/35mbps speeds, so it isn't an outright limit. AND, I can run parallel instances and can go all the way up to 35mbps, so I know the problem isn't gateway/nic/machine/amazon related. Running parallel instances works to a degree as a solution, but increases the complexity of my workflow greatly. Solving this would make my life dramatically easier.

When I was first doing this I was playing around with a bunch of Windows TCP parameters and was able to briefly get unconstrained bandwidth, but it wasn't repeatable.

Thoughts?

© Server Fault or respective owner

Related posts about amazon-s3

Related posts about Windows