Throughput measurements

Posted by dotsid on Stack Overflow See other posts from Stack Overflow or by dotsid
Published on 2010-04-21T09:29:29Z Indexed on 2010/04/21 9:33 UTC
Read the original article Hit count: 319

Filed under:

theory

|

load-testing

I wrote simple load testing tool for testing performance of Java modules. One problem I faced is algorithm of throughput measurements. Tests are executed in several thread (client configure how much times test should be repeated), and execution time is logged. So, when tests are finished we have following history:

4 test executions
2 threads
36ms overall time

- idle
* test execution
       5ms    9ms     4ms      13ms
T1  |-*****-*********-****-*************-|
      3ms  6ms     7ms      11ms
T2  |-***-******-*******-***********-----|
    <-----------------36ms--------------->

For the moment I calculate throughput (per second) in a following way: 1000 / overallTime * threadCount.

But there is problem. What if one thread will complete it's own tests more quickly (for whatever reason):

      3ms 3ms 3ms 3ms
T1  |-***-***-***-***----------------|
      3ms  6ms     7ms      11ms
T2  |-***-******-*******-***********-|
    <--------------32ms-------------->

In this case actual throughput is much better because of measured throughput is bounded by the most slow thread. So, my question is how should I measure throughput of code execution in multithreaded environment.

© Stack Overflow or respective owner

Related posts about theory

Why does NUnit ignore datapoints when using generics in a theory

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to make use of the TheoryAttribute, introduced in NUnit 2.5. Everything works fine as long as the arguments are of a defined type: [Datapoint] public double[,] Array2X2 = new double[,] { { 1, 0 }, { 0, 1 } }; [Theory] public void TestForArbitraryArray(double[,] array) { // ... } It… >>> More
How do you deal with translating theory into practice?

as seen on Programmers - Search for 'Programmers'
Hello all! Being a computer scientist in a research field I am often tasked with working alongside professionals outside of the software domain (think math people, electrical engineer etc), and then translating their theories and ideas into real-world implementations. I often find it difficult when… >>> More
Title Tag Optimization - Common Grounds Between Raw SEO Theory & Search Engine Marketing Priorities

as seen on Ezine Articles - Search for 'Ezine Articles'
All you have to know about how to properly optimize title tag if you're just starting an onpage optimization campaign. Plus some easy to implement marketing tips to attract endless visitors to your content. >>> More
Database theory - relationship between two tables

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a database with two tables - let's call them Foo and Bar. Each foo may be related to any number of bars, and each bar may be related to any number of foos. I want to be able to retrieve, with one query, the foos that are associated with a certain bar, and the bars that are associated with a… >>> More
Recommended book about parallel programming - theory & best practice?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm looking for a book or books about multicore, multithreaded programming. The perfect book should focus on best practices and maybe include a bit of theory background. I'm not interested in a book which only describes a single library and focuses on its API. OS actually doesn't matter. >>> More

Related posts about load-testing

Tools for load-testing HTTP servers?

as seen on Server Fault - Search for 'Server Fault'
I've had to load test HTTP servers/web applications a few times, and each time I've been underwhelmed by the quality of tools I've been able to find. So, when you're load testing a HTTP server, what tools do you use? And what are the things I'll most likely do wrong the next time I've got to do it? >>> More
Load testing multipart form

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to load-test a Rails application using JMeter. A critical part of the application involves a form that includes both text inputs and file uploads. It works fine in a browser, but when I try to post that page in JMeter, Rails is saving all of the parts of the multipart form as temp files… >>> More
Getting stats on cookieless session page using VS2008 load testing feature

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm load testing a web page using visual studio load testing tool, but I have problems displaying results. The problem is cookieless session. Everytime new user comes to a page, page URLL changes and I'm not able to calculate average page response time. What can be done about it? >>> More
Cloud Based Load Testing Using TF Service & VS 2013

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Originally posted on: http://geekswithblogs.net/TarunArora/archive/2013/06/30/cloud-based-load-testing-using-tf-service-amp-vs-2013.aspx One of the new features announced as part of the Visual Studio 2013 Ultimate Preview is ‘Cloud Based Load Testing’. In this blog post I’ll walk you through, … >>> More
TFS Load Testing Web Tests

as seen on Stack Overflow - Search for 'Stack Overflow'
I am configuring a load test and am curious/confused on settings. I am testing an intranet website, that is expected to have 6000 concurrent users. My employer had some previous consultant tell them that the load test users does not matter and that we need to worry about requests/second. They have… >>> More