June 29, 2009
Preface: Kids, PAY ATTENTION IN MATH CLASSES. YOU NEED IT.
So I’ve been spending a lot of time at work doing loadtests, and one question that keeps coming back is “what metric do we want to use to gauge progress?” We’ve been going with a simple throughput (pages/second), but that doesn’t take into account errors, average times, or samplecounts.
You can have 30 pages/second and have the following conditions:
average page takes 10 seconds to load (300 threads over a 10 second period) 50% error rate (pages that spit out a 500 error can return REALLY fast) 30 threads, 1 second page load That number doesn’t tell the whole story.
read more