Kafka consumer group offset retention

Question

How long does kafka store the offset of a consumer-group after all consumers in that group fail? Is there a configuration variable for this?

score 10 · Accepted Answer · answered Jul 04 '17 at 12:53

10

The right property name is:

offsets.retention.minutes

answered Jul 04 '17 at 12:53

Jacopo Silvestro

offsets.retention.minutes is at broker level. Is there anything at topic level? – user3366706 Nov 21 '17 at 19:34
This is a read-only broker config. Can we change this by any kafka cli command, Instead of server.properties. ? – mohit Feb 20 '19 at 14:51

score 8 · Answer 2 · edited Feb 19 '18 at 16:25

8

The value can be configured in kafka broker using:

offsets.retention.minutes

The default is 24 hours.

See: the Kafka broker config docs.

edited Feb 19 '18 at 16:25

Achal

answered May 02 '16 at 07:33

masih

offsets.retention.minutes is at broker level. Is there anything at topic level? – user3366706 Nov 21 '17 at 19:34

DollyShukla · Answer 3 · 2019-02-20T10:09:55.707

2

I have added following property in Kafka configuration, it changed the offset retention time to 7 days, and working good.

offsets.retention.minutes=10080

edited Feb 20 '19 at 10:09

answered Feb 19 '19 at 11:33

DollyShukla

3 Answers3