Why Apache benchmark results are inconstant?

Question

I run this command on ubuntu: ./ab -n 2000 -c 10 http://localhost:7000/index.html and each time I get a different number for "Time per request".(huge difference like once is 0.66 ms next time is 0.17 ms).

Why is the result unstable and how can I measure the actual performance of the Apache server?

Perhaps there is other activity on the server? Try shutting down all unneeded services. — Alex Howansky, Jul 05 '11 at 17:54
Thanks for your comment. No heavy activity is going on, on the server. — roham, Jul 05 '11 at 20:40
What's the content of the page? Static HTML from a file on disk? PHP with hits to a remote database? — Alex Howansky, Jul 05 '11 at 21:21

score 1 · Answer 1 · edited May 23 '17 at 11:50

If just the first request is slower than the following and the next results tend to be faster than it´s very likely some kind of cache which speeds up the response. In the simplest case this is just the disk cache of the os.

If you´re benchmarking on a virtual machine you probably will not get very credible results:

http://communities.vmware.com/docs/DOC-5581

Benchmarking, Profiling on Virtual Machines

Here some general best practices for benchmarking web servers:

http://www.cyberciti.biz/tips/howto-performance-benchmarks-a-web-server.html

Why Apache benchmark results are inconstant?

1 Answers1