How to get partitions for kafka topic using kafka-python?

Asked May 03 '18 at 08:14

Active May 05 '18 at 22:29

Viewed 2,753 times

I would like to get the offset for a kafka topic.
I tried the code mentioned here: https://stackoverflow.com/a/44685608/2762279 but it isn't working.

I found that getting the offsets requires a partition parameter end_offsets(partitions).
So, I used the underlying code to find the partitions for the topic however it returns a None.

from kafka import KafkaConsumer

topic = 'TOPIC'
consumer = KafkaConsumer(
    topic,
    bootstrap_servers=['IP:PORT'],
    client_id = 'CLI',
    group_id='GR',
    auto_offset_reset='earliest',
    consumer_timeout_ms=10000)

print(consumer.partitions_for_topic(topic))

Should i call a method (some sort of connect) before getting the partitions?

edited May 05 '18 at 22:29

asked May 03 '18 at 08:14

Amr Keleg

Is your intent to find the last offset of a partition? – void May 03 '18 at 15:04
@void Yes, i want to find the last offset. – Amr Keleg May 03 '18 at 15:11
Possible duplicate of [How to get latest offset for a partition for a kafka topic?](https://stackoverflow.com/questions/35432326/how-to-get-latest-offset-for-a-partition-for-a-kafka-topic) – void May 03 '18 at 17:58
https://stackoverflow.com/a/44685608/2408270 check this out OP – void May 03 '18 at 17:59

How to get partitions for kafka topic using kafka-python?

0 Answers0