Stack Overflow
Stack Overflow

Questions tagged [micronaut-kafka]

Related to the use of Apache Kafka producers/consumers/admins in Micronaut framework

Micronaut is a framework for building JVM microservices and serverless applications.

Apache Kafka is an open-source distributed streaming platform.

Related links

Related tags

28 questions
5
votes
3 answers

Micronaut Kafka: Health check fails with "Cluster authorization failed"

I am trying to consume messages from a Kafka cluster external to my organization, which requires authentication. I am receiving messages, so presumably things are partly correct, but I'm getting this error message in the logs: 08:54:50.840…
Imre Kerr
  • 2,388
  • 14
  • 34
3
votes
0 answers

Kafka Producer: how code onSuccess/onError callbacks with Reactive and Non-Blocking Producer

I am trying following Micronaut Kafka guide. It shows this piece of code: Single sendBook( @KafkaKey String author, Single book ); I tried implement whithout success that way Producer package com.tolearn.producer import…
Jim C
  • 3,957
  • 25
  • 85
  • 162
2
votes
1 answer

In micronaut-kafka, How can I use JAAS config to two different consumers from one application?

I have tried the approach mentioned on official documentations to override the bootstrap servers in kafka client config. https://micronaut-projects.github.io/micronaut-kafka/latest/guide/#kafkaClient However, in my case, I am getting one JaaS config…
Dharmendra Vishwakarma
  • 484
  • 2
  • 12
1
vote
0 answers

Kafka "exactly once" semantics and Micronaut framework

I have a problem implementing kafka "exactly once" semantics and Micronaut framework. I have two servers with same code that are sending messages to a kafka broker, and I have this error: org.apache.kafka.common.errors.ProducerFencedException: The…
Agustin
  • 41
  • 4
1
vote
1 answer

Exactly once semantics possible in consumer-producer-cycle with micronaut kafka?

I am trying to setup exactly once semantics using kafka transactions with micronaut kafka. I need to read records from topic A, map key and value and produce to topic B. I would like to implement this exactly once using kafka transactions. According…
Lars
  • 61
  • 4
1
vote
1 answer

Micronaut Kafka Listener : How to schedule kafka consumer poll() with 15 min interval

I want to poll the topic once every 15 minutes. I found out there is a way to do this in kafka-spring with ConcurrentKafkaListenerContainerFactory and with below configuration factory.getContainerProperties().setIdleBetweenPolls(900000); Is there…
TeaSea
  • 55
  • 6
1
vote
2 answers

Providing order to Test class execution Java

I have three test classes to test my controller, service and Kafka Messaging. When I run the Kafka messaging standalone, it works. But when I run all my test files together, the Kafka test class passes as long as it is the first one that gets…
Abhinav Mehrotra
  • 543
  • 2
  • 8
  • 17
1
vote
0 answers

Why sometimes Kafka Messaging Queue returns no message when writing Integration Test?

I have am trying to write Integration test for Kafka Messaging in my application. When I run my tests sometimes they pass and sometimes they fail. When they fail, below line in test class fails to return any message. I am not sure why it returns…
Abhinav Mehrotra
  • 543
  • 2
  • 8
  • 17
1
vote
0 answers

Kafka Streams failing with Materialized.`as`(STORE_NAME)

I am creating a streams application to enrich data from a topic, stored in a table. Everything works perfectly until i add the Materialized as api. Anyone have any idea why this happens? I have scoured the web for resources explaining this. It is…
Regine Giskegjerde Urtegård
  • 11
  • 2
1
vote
1 answer

Is it OK to call Kafka Streams StreamBuilder.build() multiple times

We're using micronaut/kafka-streams. Using this framework in order to create a streams application you build something like this: @Factory public class FooTopologyConfig { @Singleton @Named public KStream configureTopology { …
Sparky
  • 2,694
  • 3
  • 21
  • 31
1
vote
0 answers

Best practice for implementing Micronaut/Kafka-Streams with more than one KStream/KTable?

There are several details about the example Micronaut/Kafka Streams application which I don't understand. Here is the example class from the documentation (original link:…
Sparky
  • 2,694
  • 3
  • 21
  • 31
1
vote
0 answers

Rest api design with apache kafka java and micronaut application

I have the above diagram while working with the Rest API CRUD operations using Micronaut framework. I have the uni-directional flow where the controller needs to know the operation perform from the Kafka consumer API. For example To get all the…
San Jaisy
  • 15,327
  • 34
  • 171
  • 290
1
vote
0 answers

Reactive and Non-Blocking Method Micronaut with apache kafka

I am trying to get the Non-Blocking response from the Micronaut kafka implementation, however the return value in not working. public class ProductManager implements IProductManager{ private final ApplicationContext applicationContext; …
San Jaisy
  • 15,327
  • 34
  • 171
  • 290
0
votes
0 answers

how to consume kafka topics in sequence in Micronaut

topic 1 and topic 2 i want to be able to consume topic 1 and only after consuming the message start consuming topic 2 message. I tried to sendTo the data from topic1 to topic2 and setting autoStartUp() property to false for topic2 but how do i hold…
Sindhu S
  • 1
  • 1
0
votes
1 answer

RabbitMq Consumer not working because micronaut assigns executor threads to kafka consumer

I am running kafka in micronaut v3.4.3 in Kotlin and recently I integrated RabbitMq with the server using micronaut-rabbitmq v3.4.0. In the docs it is mentioned to specify the executors for the RabbitMq consumers in application.yml. Now when the…
Sarthak Gupta
  • 1
  • 1
1
2