Kafka Consumer API not subscribing using Java client

Question

Kafka: 0.10.1.0 (Client & Server) Java client. Zookeeper: 3.4.6

Setup: Producer publishes messages. Sent messages on topic counted using ./kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9093 --topic TEST.TOPIC --time -1

Issue Consumer when polled while subscribing doesn't work but if you manually assign() - it works. There had been a separate thread on same question but no answer. It may be UUID issue but need more details as we are in evaluating phase and details would help.

Consumer Settings: props.put("bootstrap.servers", servers); props.put("enable.auto.commit", ENABLE_AUTO_COMMIT);

    props.put("auto.commit.interval.ms", AUTO_COMMIT_INTERVAL_MS);
    props.put("session.timeout.ms", SESSION_TIMEOUT_MS);
    props.put("group.id", CONSUMER_GROUP_ID);
    props.put("key.deserializer", STRING_DESRIALIZER);
    props.put("value.deserializer", STRING_DESRIALIZER);
    props.put("auto.offset.reset", "earliest");

are you using the command line consumer? can you share the consumer configurations? — daniel, May 11 '17 at 17:11
updated. I am using Java client (KafkaConsumer). When I use subscribe(topics) - doesn't work. assign(topicPartitions) - Works. — amit.shipra, May 11 '17 at 17:34
do you have the following property set in kafka properties? `etc/kafka/server.properties usually. listeners=PLAINTEXT://:` This tells kafka to listen for consumers here in plaintext (vs ssl). — daniel, May 11 '17 at 17:39
@daniel - listeners property would be required by both subscribe() and assign() methods - correct? Is it possible that this proeprty is useful for only one mechanism? — amit.shipra, May 11 '17 at 17:57

score 0 · Answer 1 · answered Jun 09 '17 at 19:15

0

Issue was with Version of Kafka.

Switched to 0.10.2.1 (server and client) and subscribe() worked flawlessly.

answered Jun 09 '17 at 19:15

amit.shipra

167
2
16

Kafka Consumer API not subscribing using Java client

1 Answers1