Questions tagged [yahoo-kafka-manager]

30 questions
5
votes
2 answers

Unable to delete kafka topic

I am using kafka, zookeeper and kafka-manager for managing clusters. I have 3 nodes cluster. In all the cluster I set since very beginning delete.topic.enable=true Now when I want to delete a topic it is showing following error. topicxyz - marked…
Avinash
  • 2,093
  • 4
  • 28
  • 41
4
votes
1 answer

Reduce topic replication factor with Kafka manager or Kafka cli

There are currently 22 replicas configured for specific topic in Kafka 0.9.0.1. Is it possible to reduce the replication factor of the topic to 3? How to do it via Kafka CLI or Kafka Manager? I found a way to increase replicas number only here
rok
  • 9,403
  • 17
  • 70
  • 126
3
votes
1 answer

How can I restart kafka-manager safely with out kill command?

my kafka-manager can't update consumer information and keeps the removed consumer groups list, so i try to restart kafka-manager. (i'm using kafka-manager 1.3.3.22 and kafka 2.12-2.1.1) but README.md in kafka-manager and /bin/kafka-manager command…
Junhaeng Heo
  • 105
  • 1
  • 7
3
votes
0 answers

Kafka-Manager Web UI not loading

I have started kafka-manager on centos VM and below are its logs. [info] o.a.z.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib [info] o.a.z.ZooKeeper - Client…
anuja Mandlecha
  • 115
  • 1
  • 9
3
votes
1 answer

Kafka 0.10.0.1 partition reassignment after broker failure

I'm testing kafka's partition reassignment as a precursor to launching a production system. I have several topics with 9 partitions each and a replication factor of 3. I've killed one of the brokers to simulate a failure condition and verified that…
novon
  • 973
  • 3
  • 15
  • 30
2
votes
1 answer

How to understand which partition replica kafka broker is down

There's topic with 22 replicas, 50 partitions and 22 running Kafka brokers. Topic manual assignment screen in Kafka Manager shows that there's Broker Down in all topic partitions as seen in the image. How to determine Kafka broker that's down using…
rok
  • 9,403
  • 17
  • 70
  • 126
2
votes
1 answer

How to check a Kafka node restart is completely healthy before moving onto the next in large clusters?

Is there a more indepth query or endpoint I can hit for Kafka to tell me it is all caught up with partitions, it has rejoined the cluster and it can talk to all listed brokers and Zk nodes - and that there are no Java exceptions in the logs? Perhaps…
eduncan911
  • 17,165
  • 13
  • 68
  • 104
2
votes
2 answers

kafka-manager not able to read from kafka docker JMX port exposed

I am not able to get my kafka-manager to show messages data/metrics. I am running kafka-manager locally with the below command, bin/kafka-manager -Dkafka-manager.zkhosts="localhost:2181" Also I am checking enable JMX polling on start option. I am…
user7222071
  • 21
  • 1
  • 2
2
votes
0 answers

Kafka Broker throws SchemaException: Error reading field 'topics (with Kafka-Manager)

I am getting the following exception while using Kafka-manager(1.3.1.*) with Kafka(0.8.2.1) cluster. ERROR Closing socket for /XX.XX.XX.XX because of error (kafka.network.Processor) org.apache.kafka.common.protocol.types.SchemaException: Error…
Jaipal
  • 147
  • 1
  • 9
1
vote
0 answers

CMAK Error A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply

I have integrated the ELK system concept in node js. So Kibana , Kafka, kafka manager, Zookeeper are installed in docker in my local system. Everything is running in the docker window perfectly. I am getting some errors so I could not create a…
Vincent
  • 53
  • 11
1
vote
1 answer

KeeperErrorCode = Unimplemented for /kafka-manager/mutex

The following error is being prompted when it is tried to add a new cluster in 'CMAK' in the K8s cluster. Yikes! KeeperErrorCode = Unimplemented for /kafka-manager/mutex Try again. My cluster configurations are as follows, zookeeper:…
1
vote
0 answers

Kafka Manager - need to keep track of the users using it for security

Need to know if we can find the who has logged on to the Kafka Manager. It is for security so that can track who accessed the web page. So source ip and a request url would be preferred. How can I get the above info?
1
vote
0 answers

Pending (stuck) reassign partitions in Kafka manager

The below reassign partition operation is stuck when performed via Kafka Manager. Kafka version is 0.9.0.1. Is the a way to understand why and let it progress? Going to try kafka-reassign-partitions.sh instead
rok
  • 9,403
  • 17
  • 70
  • 126
1
vote
1 answer

Kafka reset tool Consumer offset not resetting to zero

I am trying to understand some fundamental Kafka concepts so that I can properly monitor the progress of my KafkaStreams based application. Specifically for debugging purposes I need to be able to have my application re-consume a whole topic. For…
1
vote
0 answers

How to identify a new topic created in a kafka cluster?

I want to identify any new topic created in Kafka cluster. Using zookeeper we can get a list of topics created. But I want to continuously get alerts for new topics created. Also is there a way to solve this using yahoo Kafka manager or LinkedIn…
1
2