Stack Overflow
Stack Overflow

Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

154 questions
253
votes
24 answers

Tactics for using PHP in a high-load site

Before you answer this I have never developed anything popular enough to attain high server loads. Treat me as (sigh) an alien that has just landed on the planet, albeit one that knows PHP and a few optimisation techniques. I'm developing a tool in…
Ross
  • 46,186
  • 39
  • 120
  • 173
36
votes
4 answers

jQuery/Javascript - How to wait for manipulated DOM to update before proceeding with function

What I'm trying to do is to update a simple div to say "Processing..." before executing a CPU-intensive script (it takes 3-12 seconds to run, no AJAX) then update the div to say "Finished!" when done. What I'm seeing is the div never gets updated…
pcormier
  • 568
  • 1
  • 5
  • 15
27
votes
0 answers

SignalR fails under high load

I have a website with very high load and keeping my test app under a hidden iframe to make sure that the target framework is a good choice for my use case. First tried SignalR test app and then Pokein under same server config. Currently we are using…
Tomm Hill
  • 444
  • 4
  • 9
24
votes
3 answers

Java High-load NIO TCP server

As a part of my research I'm writing an high-load TCP/IP echo server in Java. I want to serve about 3-4k of clients and see the maximum possible messages per second that I can squeeze out of it. Message size is quite small - up to 100 bytes. This…
Juriy
  • 5,009
  • 8
  • 37
  • 52
18
votes
2 answers

Does Nginx becomes redundant if we have AWS Application Load balancer for a Node application?

I have a Node application running on AWS. When moving into production, there is a very high chance that it will get a very high number of requests. I'm planning to host it using AWS ECS and there will be an AWS Application load balancer in front of…
Neron Joseph
  • 1,675
  • 22
  • 39
17
votes
4 answers

What caused socket connections to be slow after Full GC?

We have a client server app, 1 server, about 10 clients. They communicate via tcp sockets using custom queries. The system had been running smooth for many months, but at some point, after the daily scheduled server FULL GC that took about 50s, we…
dcernahoschi
  • 14,968
  • 5
  • 37
  • 59
14
votes
3 answers

C: epoll and multithreading

I need to create specialized HTTP server, for this I plan to use epoll sycall, but I want to utilize multiple processors/cores and I can't come up with architecture solution. ATM my idea is followng: create multiple threads with own epoll…
Daniel
  • 4,272
  • 8
  • 35
  • 48
13
votes
1 answer

uWSGI python highload configuration

We have a big EC2 instance with 32 cores, currently running Nginx, Tornado and Redis, serving on average 5K requests per second. Everything seems to work fine, but the CPU load already reaching 70% and we have to support even more requests. One of…
offline15
  • 347
  • 3
  • 6
  • 14
13
votes
1 answer

SignalR performance

We have a web-based game (SignalR for communication), our workload will be: 5,000 - 20,000 concurrent client with 0.5 - 2 messages/client/second ~= 10-40k messages/secs with the following server is there any problem handle the load (assume that…
Viet NT
  • 305
  • 2
  • 9
12
votes
1 answer

Gunicorn with max-request limit blocks on high load

I'm trying to understand the following scenario: I have a website with nginx in front (serving with SSL, config see below) requests to the Django application are handled by gunicorn (0.18, config see below, managed by supervisord) when a user loads…
dArignac
  • 1,205
  • 4
  • 11
  • 25
10
votes
2 answers

Redis periodically stops responding on high load

I am using a simple redis server setup to store some values in my PHP application. Yesterday I installed phpredis module to use redis as PHP Session backend, which increased request rate on redis DB form 100 to 2000, and DB size from 60Mb to…
Silver Light
  • 44,202
  • 36
  • 123
  • 164
8
votes
1 answer

How php-fpm manages workers with dynamic process manager?

I would like to clarify how php-fpm manages workers with dynamic process manager. Let's assume we have following config: pm = dynamic pm.max_children = 100 pm.start_servers = 30 pm.min_spare_servers = 20 pm.max_spare_servers = 60 when php-fpm…
hennadiy.verkh
  • 972
  • 2
  • 11
  • 16
7
votes
5 answers

What would you recommend for a high traffic ajax intensive website?

For a website like reddit with lots of up/down votes and lots of comments per topic what should I go with? Lighttpd/Php or Lighttpd/CherryPy/Genshi/SQLAlchemy? and for database what would scale better / be fastest MySQL ( 4.1 or 5 ? ) or PostgreSQL?
daniels
  • 18,416
  • 31
  • 103
  • 173
6
votes
4 answers

How can I make nginx return a static response and send request headers to app?

I am making a high-load web statistics system through embedding tag to site. The thing I want to do is: nginx gets request for an image from some host it gives as answer to host little 1px static image from filesystem at this time it somehow…
sandrew
  • 3,109
  • 5
  • 19
  • 29
6
votes
3 answers

How digg (or other high load category websites) are storing user sessions?

How does digg or any other high-traffic website store user sessions? What do they use for storing the user sessions? File system, DB (which one?), memcache or both? Let's imagine a simple situation. Logged user has set the flag "Remember me" during…
Kirzilla
  • 16,368
  • 26
  • 84
  • 129
1
2 3
…
10 11