Behaviour of Vert.x Event-bus when reaching the limit

Question

I'm missing one piece of understanding of how Event Bus / Hazelcast works.

Imagine a case with a consumer and a producer verticles communicating over the clustered EB. The consuming part is doing CPU / memory / IO-intensive calculations.

When at some point due to the load the consumer is not able to handle the messages immediately, what is going to happen?

Would the messages be queueed inside the ring-buffer and eventually be processed later (considering Netty's SingleThreadEventLoop limits of 2 billion as per Size of event bus in vert.x)? Will they be dropped in case of reaching the limit?

In general, can the messages in EB be considered persistent and with delivery guarantee, as soon as no component in the cluster crashes?

tsegismont · Accepted Answer · 2019-12-11T13:34:04.003

5

If the consumers cannot cope with the messages, Vert.x will accumulate messages in a queue in memory.

When the queue reaches its limit, the messages will be dropped. The number of elements in the queue can be configured with MessageConsumer.html#setMaxBufferedMessages. It does not depend on message size.

If you need delivery guarantees, don't use the EventBus, use a messaging system like ActiveMQ (Vert.x has clients for such messaging systems).

In general, Vert.x does its best not to lose messages but the EventBus is simply not a full-featured messaging system.

edited Dec 11 '19 at 13:34

answered Dec 10 '19 at 19:56

tsegismont

8,591
1
17
27

and what is the limit of the queue? how does it depend on messages' size? – injecteer Dec 10 '19 at 21:19
what if the JMS or Kafka broker also reached the limit, would the messages be also dropped? – injecteer Dec 11 '19 at 09:21
I edited the response. With respect to JMS broker or Kafka you can refer to their documentation. – tsegismont Dec 11 '19 at 13:34
1

can the message queue size be monitored? – injecteer Dec 13 '19 at 09:12
2

You can set a `discardHandler` on the message consumer to get notified when messages are discared – tsegismont Dec 13 '19 at 11:06

Behaviour of Vert.x Event-bus when reaching the limit

1 Answers1

Linked