Questions tagged [strimzi]

Strimzi is an open source project to allow Apache Kafka runs in container such as Kubernetes and OpenShift.

Strimzi is an open source project to allow Apache Kafka runs in container such as Kubernetes and OpenShift.

198 questions
6
votes
1 answer

Kafka MirrorMaker2 automated consumer offset sync

I am using MirrorMaker2 for DR. Kafka 2.7 should support automated consumer offset sync Here is the yaml file I am using (I use strimzi for creating it) All source cluster topics are replicated in destination cluster. Also ...checkpoint.internal…
Inako
  • 259
  • 5
  • 13
5
votes
2 answers

How to use Kafka connect in Strimzi

I am using Kafka with strimzi operator, I created a Kafka cluster and and also deployed Kafka connect using yml file. But after this I am totally blank what to do next . I read that Kafka connect is used to copy data from a source to Kafka cluster…
4
votes
1 answer

Kafka incremental sticky rebalancing

I am running Kafka on Kubernetes using the Kafka Strimzi operator. I am using incremental sticky rebalance strategy by configuring my consumers with the following: ConsumerConfig.PARTITION_ASSIGNMENT_STRATEGY_CONFIG, …
Mazen Ezzeddine
  • 662
  • 1
  • 8
  • 28
4
votes
1 answer

Strimzi operator Kafka cluster ACL not enabling with type: simple

We know to enable Kafka ACL property authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer to be added in server.properties but how to enable that if Kafka cluster is running by Strimzi operator? From Strimzi documents I have come to know in…
3
votes
1 answer

What is the difference between confluent kafka-rest & Strimzi Kafka Bridge

I would like to use a HTTP proxy on top of Kafka. I see two projects with same purpose : https://github.com/confluentinc/kafka-rest https://github.com/strimzi/strimzi-kafka-bridge I use strimzi operator to spin up Kafka on Kubernetes. Both are…
Sairam Krish
  • 10,158
  • 3
  • 55
  • 67
3
votes
0 answers

Structured Streaming - suddenly giving error while writing to (Strimzi)Kafka topic

i've a Structured Streaming code which reads data from a Kafka Topic (on a VM) & writes to another Kafka Topic on GKE (i should be using a Mirror Maker for this, but have not implemented that yet). it suddenly stopped working (been working fine for…
3
votes
0 answers

ERROR org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call

I've tried to connect for the first time to kafka cluster in Kubernetes (Strimzi operator) over TLS. The TLS connection is working as I am able to connect using kafkacat. The issue seems to be with the Java client only. kafka-topics.sh…
2
votes
2 answers

Difference between Kafka operator vs kafka helm chart

Can anyone explain in simple terms what is the difference between deploying Kafka through Kubernetes operator (for example Strimzi ) and Kafka helm chart or manifest file? Previously in my project we used helm chart for kafka but for now we've…
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
2
votes
2 answers

Prometheus doesn't discover my pod monitor

I want to monitor my Kafka deployed using Strimzi operator. I deployed Prometheus operator alongside a few basic monitoring tools using community chart https://github.com/prometheus-community/helm-charts/tree/main/charts/kube-prometheus-stack, then…
Kostya Zgara
  • 73
  • 1
  • 6
2
votes
1 answer

Strimzi Kafka Listener Custom Cert configuration

I am trying to configure Strimzi Kafka listener custom cert, following the documentation: https://strimzi.io/docs/operators/latest/full/configuring.html#ref-alternative-subjects-certs-for-listeners-str I want to expose those listener outside of the…
Krzysztof
  • 31
  • 3
2
votes
0 answers

Is there way to map RabbitMQ routing key in Kafka connnector configurations for registering RabbitMQSourceConnector?

We have microservices which are communicating each other via RabbitMQ. For example :- we have services ServiceA, ServiceB, ServiceC. ServiceA sends ADto message to ServiceB via RabbitMq with routing key service.a.100 ServiceB sends BDto message to…
2
votes
1 answer

Remote debugging custom Kafka connector with Strimzi deployment on Kubernetes

I would like to remote debug my custom connector which is part of my Strimzi Kafka operator deployment on top of Kubernetes. Locally (e.g. with docker image), this could be done by adding the JAVA_TOOL_OPTIONS as an environment parameter with this…
omer bar lev
  • 341
  • 1
  • 4
  • 11
2
votes
1 answer

Kafka topic not found when running strimzi on docker-desktop k8s cluster

I try to run strimzi on docker-desktop k8s, following this document. I set up all the things. $ kubectl get all -n my-kafka-project NAME READY STATUS …
lipsum
  • 919
  • 2
  • 13
  • 24
2
votes
1 answer

SSL handshake failed in Kafka broker

I have a Kafka cluster in Kubernetes created using Strimzi. apiVersion: kafka.strimzi.io/v1beta1 kind: Kafka metadata: name: {{ .Values.cluster.kafka.name }} spec: kafka: version: 2.7.0 replicas: 3 storage: deleteClaim: true …
Inako
  • 259
  • 5
  • 13
2
votes
2 answers

How to list Kafka topics while I am using strimzi operator

Hey I am usin Kafka Strimzi. I created my kafkaTopic and KafkaUser using following yml files: apiVersion: kafka.strimzi.io/v1beta1 kind: KafkaUser metadata: name: my-user labels: strimzi.io/cluster: my-cluster spec: authentication: …
rohit290554
  • 79
  • 3
  • 10
1
2 3
13 14