Questions tagged [capacity-planning]

Capacity planning is the science and art of estimating the space, computer hardware, software and connection infrastructure resources that will be needed over some future period of time.

As per techtarget definition:

Capacity planning is the science and art of estimating the space, computer hardware, software and connection infrastructure resources that will be needed over some future period of time.

A typical capacity concern of many enterprises is whether resources will be in place to handle an increasing number of requests as the number of users or interactions increase.

The aim of the capacity planner is to plan so well that new capacity is added just in time to meet the anticipated need but not so early that resources go unused for a long period. The successful capacity planner is one that makes the trade-offs between the present and the future that overall prove to be the most cost-efficient.

Basic steps of capacity planning:

  1. Determine Service Level Requirements
    The first step in the capacity planning process is to categorize the work done by systems and to quantify users’ expectations for how that work gets done.
  2. Analyze Current Capacity
    Next, the current capacity of the system must be analyzed to determine how it is meeting the needs of the users.
  3. Planning for the future
    Finally, using forecasts of future business activity, future system requirements are determined. Implementing the required changes in system configuration will ensure that sufficient capacity will be available to maintain service levels, even as circumstances change in the future.

Capacity planning activities:

  • capacity analysis and prediction for storage, database, and application servers;
  • designing architectures to easily add and measure capacity.
  • handling sudden spikes.
  • predicting exponential and explosive growth.

Do not confuse performance with capacity: performance is based more on human work, and capacity is based more on computer resources.

75 questions
100
votes
2 answers

Caveats of select/poll vs. epoll reactors in Twisted

Everything I've read and experienced ( Tornado based apps ) leads me to believe that ePoll is a natural replacement for Select and Poll based networking, especially with Twisted. Which makes me paranoid, its pretty rare for a better technique or…
David
  • 17,673
  • 10
  • 68
  • 97
44
votes
8 answers

How do I enable FFMPEG logging and where can I find the FFMPEG log file?

I want to be able to log FFMPEG processes because I am trying to work out how long a minute of video takes to convert to help with capacity planning of my video encoding server. How do I enable logging and where is the log file saved. I have FFMPEG…
undefined
  • 5,190
  • 11
  • 56
  • 90
29
votes
6 answers

How do you do website capacity planning?

I just read the book The Art of Capacity planning (BTW, I liked it), and in it the author explains how important is measuring your services, finding out your ceilings, forecasting your needs, ensure a easygoing deployment, etc.. etc.. But through…
vtortola
  • 34,709
  • 29
  • 161
  • 263
19
votes
3 answers

Queuing theory for programmers?

After being burnt several times on things that seemed "obviously fast enough" but sucked performance-wise under load, I'm starting to think that my "gut feeling" might be not enough when doing capacity planning, and some theoretical background is…
jkff
  • 17,623
  • 5
  • 53
  • 85
16
votes
2 answers

How can I calculate database design storage costs?

I often have a couple different schema's in mind when starting project. After making rough guesses I realize that some are less optimized for growth or storage space than others. Obviously, the size of the column value is the main thing. But table…
Xeoncross
  • 55,620
  • 80
  • 262
  • 364
16
votes
3 answers

Sizing and Capacity Planning Tips and How-to

I am often asked to perform sizing and capacity planning for our clients. When our clients buy our products (basically J2EE web applications), they often ask what hardware they will need to run those products. Our recommendations often result in…
Dan
  • 11,077
  • 20
  • 84
  • 119
13
votes
2 answers

Theoretical minimum round-trip-time for a packet to travel over/under the North Atlantic Sea?

I'm doing some performance tuning and capacity planning for a low-latency application and have the following question: What is the theoretical minimum round-trip time for a packet sent between a host in London and one in New York connected via…
knorv
  • 49,059
  • 74
  • 210
  • 294
8
votes
4 answers

Best way to determine the number of servers needed

How much traffic can one web server handle? What's the best way to see if we're beyond that? I have an ASP.Net application that has a couple hundred users. Aspects of it are fairly processor intensive, but thus far we have done fine with only one…
Jared
  • 7,165
  • 6
  • 49
  • 52
7
votes
1 answer

What are the crucial key items in recording technical debt?

I'm setting up a technical debt register at The Office and want to make it a fairly comprehensive tool. What are the key pieces of information that we should be recording?
Phil.Wheeler
  • 16,748
  • 10
  • 99
  • 155
6
votes
3 answers

Yarn - How does yarn.scheduler.capacity.root.queue-name.maximum-capacity works?

I have 4 queues under the root queue with the following configuration. |-------------|-----------------|---------------------|-------------------| | Queue Name | Capacity (in %) | Max Capacity (in %) | User Limit Factor…
Vikash Pareek
  • 1,063
  • 14
  • 30
4
votes
1 answer

Kafka Capacity Planning

My employer has a Kafka cluster handling valuable data. Is there any way we can get an idea of what percent capacity our cluster is running at? Can our cluster handle larger volumes of traffic? Can we survive for an hour or a day if a single node…
clay
  • 18,138
  • 28
  • 107
  • 192
4
votes
2 answers

How can I do a capacity planning of my web application and decide the deployment architecture?

I have an ASP.net web application deployed on the small AWS instance (Dual Core AMD, 2.60 GHz, 1.7 GB RAM). I would like to perform load testing on this server for 300 concurrent users and for future, I want to design the tentative capacity planning…
Amar
  • 257
  • 2
  • 6
  • 14
4
votes
2 answers

How do I estimate SQL Server index sizes

While estimating straight row and table sizes are fairly simple math, we find it challenging to guess just how much space each index will occupy (for a given table size). What areas can we learn to calculate a better estimate and growth rate for…
icelava
  • 9,787
  • 7
  • 52
  • 74
3
votes
2 answers

Web server capacity planning: more cores versus more memory

We have an ASP.NET project (40 or so Web forms, 50 tables, pretty standard IO stuff with care taken to minimize when possible) that will soon need to be deployed. There will be about 100 concurrent users on the system, but only about 20 at any one…
rp.
  • 17,483
  • 12
  • 63
  • 79
3
votes
1 answer

How much memory does an inet stream socket use in Node.js?

Of course data can be buffered and grow if the client is too slow to read the server's writes [1]. But what is the default buffer size? I assume it's whatever is configured in /proc/sys/net/ipv4/tcp_rmem and tcp_wmem (assuming Linux)... I'm trying…
horton
  • 53
  • 5
1
2 3 4 5