Questions tagged [latency]

This tag implies latency is a significant consideration

Latency is a time interval between the stimulation and response, or, from a more general point of view, as a time delay between the cause and the effect of some physical change in the system being observed.

Latency is physically a consequence of the limited velocity with which any physical interaction can propagate.

This velocity is always lower or equal to speed of light.

Therefore every physical system that has spatial dimensions different from zero will experience some sort of latency, regardless of the nature of stimulation that it has been exposed to.

The precise definition of latency depends on the system being observed and the nature of stimulation.

In communications, the lower limit of latency is determined by the medium being used for communications.

In reliable two-way communication systems, latency limits the maximum rate that information can be transmitted, as there is often a limit on the amount of information that is "in-flight" at any one moment.

In the field of human–machine interaction, perceptible latency has a strong effect on user satisfaction and usability.

Related tag:

1231 questions
222
votes
20 answers

How do I simulate a low bandwidth, high latency environment?

I need to simulate a low bandwidth, high latency connection to a server in order to emulate the conditions of a VPN at a remote site. The bandwidth and latency should be tweakable so I can discover the best combination in order to run our software…
Nic
  • 4,319
  • 5
  • 29
  • 36
216
votes
5 answers

Approximate cost to access various caches and main memory?

Can anyone give me the approximate time (in nanoseconds) to access L1, L2 and L3 caches, as well as main memory on Intel i7 processors? While this isn't specifically a programming question, knowing these kinds of speed details is neccessary for some…
Ted Graham
  • 3,511
  • 4
  • 24
  • 25
214
votes
5 answers

How does LMAX's disruptor pattern work?

I am trying to understand the disruptor pattern. I have watched the InfoQ video and tried to read their paper. I understand there is a ring buffer involved, that it is initialized as an extremely large array to take advantage of cache locality,…
Shahbaz
  • 10,395
  • 21
  • 54
  • 83
139
votes
5 answers

Reducing garbage-collection pause time in a Haskell program

We are developing a program which receives and forwards "messages", while keeping a temporary history of those messages, so that it can tell you the message history if requested. Messages are identified numerically, are typically around 1 kilobyte…
jameshfisher
  • 34,029
  • 31
  • 121
  • 167
107
votes
10 answers

fastest (low latency) method for Inter Process Communication between Java and C/C++

I have a Java app, connecting through TCP socket to a "server" developed in C/C++. both app & server are running on the same machine, a Solaris box (but we're considering migrating to Linux eventually). type of data exchanged is simple messages…
Bastien
  • 1,537
  • 2
  • 10
  • 19
104
votes
2 answers

How does Amazon RDS backup/snapshot actually work?

I am an Amazon RDS customer and am experiencing daily amazon RDS write latency spikes, corresponding roughly to the backup window. I will also see spikes at the end of a snapshot (case in point: running a snapshot takes appx 1 hour, and in the final…
esilver
  • 27,713
  • 23
  • 122
  • 168
52
votes
2 answers

Why does Monitor.PulseAll result in a "stepping stair" latency pattern in signaled threads?

In a library using Monitor.PulseAll() for thread synchronization, I noticed that the latency from the time PulseAll(...) is called to the time a thread is woken up seems to follow a "stepping stair" distribution -- with extremely large steps. The…
Chuu
  • 4,301
  • 2
  • 28
  • 54
52
votes
2 answers

What do we mean by "top percentile" or TP based latency?

When we discuss performance of a distributed system we use the terms tp50, tp90, tp99.99 TPS. Could someone explain what do we mean by those?
user1071840
  • 3,522
  • 9
  • 48
  • 74
49
votes
6 answers

preconnect vs dns-prefetch resource hints

https://www.w3.org/TR/resource-hints/ If I understand correctly, both are used to initiate an early connection to load resources faster at a later time. preconnect is just doing "more". Apart from a better browser support, is there any reason to use…
Robin Drexler
  • 4,307
  • 3
  • 25
  • 28
46
votes
6 answers

What is the difference between latency, bandwidth and throughput?

I am struggling to draw a clear line between latency, bandwidth and throughput. Can someone explain me in simple terms and with easy examples?
kgs
  • 1,654
  • 2
  • 18
  • 19
46
votes
7 answers

Fastest technique to pass messages between processes on Linux?

What is the fastest technology to send messages between C++ application processes, on Linux? I am vaguely aware that the following techniques are on the table: TCP UDP Sockets Pipes Named pipes Memory-mapped files are there any more ways and what…
user997112
  • 29,025
  • 43
  • 182
  • 361
41
votes
2 answers

How to prefetch data using a custom python function in tensorflow

I am trying to prefetch training data to hide I/O latency. I would like to write custom Python code that loads data from disk and preprocesses the data (e.g. by adding a context window). In other words, one thread does data preprocessing and the…
read Read
  • 5,765
  • 4
  • 29
  • 30
34
votes
6 answers

What is the difference between latency and response time?

I started to read famous Martin Fowler book (Patterns of Enterprise Application Architecture) I have to mention that I am reading the book translated into my native language so it might be a reason of my misunderstanding. I found their definitions…
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
30
votes
5 answers

Dealing with Latency in Networked Games

I'm thinking about making a networked game. I'm a little new to this, and have already run into a lot of issues trying to put together a good plan for dead reckoning and network latency, so I'd love to see some good literature on the topic. I'll…
Nick Retallack
  • 18,986
  • 17
  • 92
  • 114
30
votes
6 answers

How can I find the response time (latency) of a client in NodeJS with sockets (socket.io)?

I'm trying to create a multiplayer game with NodeJS and I want to synchronize the action between clients. What would be the best way to find the latency (the time that a request take to come back to the client) between the client and the server? My…
FR6
  • 3,157
  • 3
  • 24
  • 28
1
2 3
82 83