3

I am aware of kafka consumers , commit offsets etc .. However, the place where there are multiple interpretations about auto commit.

How does kafka consumer auto commit work? Need clarification about Kafka auto commit and auto.commit.interval.ms

From https://www.javaworld.com/article/3066873/big-data/big-data-messaging-with-kafka-part-2.html?page=2,

Auto commits: You can set auto.commit to true and set the auto.commit.interval.ms property with a value in milliseconds. Once you've enabled this, the Kafka consumer will commit the offset of the last message received in response to its poll() call. The poll() call is issued in the background at the set auto.commit.interval.ms.

The phrase - "The poll() call is issued in the background at the set auto.commit.interval.ms" seems contradicting sometimes as it seems not the case. As the autocommit happens as part of pool loop and NOT in the background exactly at auto.commit.interval.ms. Please confirm

  1. Does auto commit happens in the background exactly @ auto.commit.interval.ms though pool is not invoked?
OneCricketeer
  • 179,855
  • 19
  • 132
  • 245
Nag
  • 1,818
  • 3
  • 24
  • 41

1 Answers1

0

I have exactly the same question. I see that 'in the background` stuff pop up in a lot of places which is quite confusing. The best explanation I could find: https://docs.confluent.io/platform/current/clients/consumer.html#message-handling

Ant
  • 181
  • 2
  • 14