Questions tagged [spring-cloud-stream-binder-kinesis]
17 questions
2
votes
1 answer
Propagating trace IDs across HTTP REST and Kinesis messaging service boundaries after migrating to Spring Boot 3.0.1/Spring Cloud 2022.0.0
I am in the middle of migrating code from Spring Boot 2.7.7/Spring Cloud 2021.0.5 to Spring Boot 3.0.1/Spring Cloud 2022.0.0. As part of this migration, I now am using io.micrometer:micrometer-tracing-bridge-otel. While I have my code functionally…
Keith Bennett
- 733
- 11
- 25
1
vote
1 answer
StsWebIdentityTokenFileCredentialsProvider autoconfiguration not working with Spring Cloud AWS 3.0.1 and SCS Binder for Kinesis 4.0.0
After reading the documentation, I feel like all I needed to do was add the software.amazon.awssdk:sts dependency and Spring would autoconfigure the StsWebIdentityTokenFileCredentialsProvider, but I always get the following error when writing a…
Keith Bennett
- 733
- 11
- 25
1
vote
1 answer
class [B cannot be cast to class java.util.List ([B and java.util.List are in module java.base of loader 'bootstrap')
I got this error when i try to consume records from kinesis: class [B cannot be cast to class java.util.List ([B and java.util.List are in module java.base of loader 'bootstrap') so it looks like the payload is coming in another type or so.
Note: if…
mibrahim.iti
- 1,928
- 5
- 22
- 50
1
vote
1 answer
Route based on payload in Spring Cloud Stream
Is it possible to use spring.cloud.function.routing-expression to route based on some field in the payload rather than headers? I have a use case where the pubisher most probably won't be sending headers.
From what I understand, payload conversion…
Henry
- 67
- 5
0
votes
0 answers
Scaling AWS Kinesis with Spring binding
I'm going to have three different microservices which one will produce a GPS data to AWS kinesis. Second and third one will consume it basically.
Since I'll have two different consumers I wanted to implement this via Kinesis streams. This's how I…
Sercan Ozdemir
- 4,641
- 3
- 34
- 64
0
votes
0 answers
Consumer retry configuration not working for Spring Cloud Stream Binder for AWS Kinesis
I have a configuration similar to the following for my Kinesis stream:
spring:
cloud:
function:
definition: personEvent
stream:
bindings:
personEvent-in-0:
consumer:
back-off-initial-interval:…
Keith Bennett
- 733
- 11
- 25
0
votes
0 answers
How can I send metrics to to a kinesis destination?
I am using spring cloud stream with the aws kinesis binder.
I have set the following :
spring.cloud.stream.bindings.applicationMetrics.destination=metrics-stream spring.cloud.stream.metrics.properties=spring.application**…
Dominic Martino
- 1
- 1
0
votes
1 answer
When will Spring Cloud AWS 3.0.0 be released?
When is the planned release date for Spring Cloud AWS 3.0.0? I checked https://calendar.spring.io/ and do not see a planned release date published there. We are migrating our microservices to use Spring Boot 3.0.0, Spring Cloud 2022.0.1, and Spring…
Keith Bennett
- 733
- 11
- 25
0
votes
1 answer
How to set dynamic partition key in spring cloud aws kinesis binder?
I am trying to use Supplier/Consumer to produce and consume messages from Kinesis data stream. Is there a way to add partition key dynamically?
private BlockingQueue messages = new LinkedBlockingQueue<>();
@Bean
public…
Kanika
- 3
- 4
0
votes
1 answer
KCL doesn't PUT or GET and items from DynamoDB checkpoint or locks tables
I implemented reading messages from Kinesis using KCL, but when i check DynamoDB tables, i found that only group table have the list of shards, but checkpoint table and locks table doesn't have any items:
Any idea why KCL doesn't PUT or GET items…
mibrahim.iti
- 1,928
- 5
- 22
- 50
0
votes
0 answers
KCL Encountered an exception while renewing a lease
I implement reading from AWS/Kinesis stream using KCL, but after read many messages from shards, suddenly i see this error in server logs:
ERROR 1 --- [oordinator-0000] c.a.s.kinesis.leases.impl.LeaseRenewer : Encountered an exception while…
mibrahim.iti
- 1,928
- 5
- 22
- 50
0
votes
0 answers
KCL reader AWS instances goes down quickly due to heap memory exception
I wrote next implementation to read messages from AWS Kinesis and deployed it on AWS ECS:
Application.java
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import…
mibrahim.iti
- 1,928
- 5
- 22
- 50
0
votes
1 answer
Confusing messaging regarding the future of Spring Cloud Schema Registry
Here, it's explained that "starting with 3.2.x release of Spring Cloud Stream, we stopped shipping the schema registry clients (artifacts such as spring-cloud-schema-registry-client) as part of Spring Cloud Stream." If this is true, then can someone…
Keith Bennett
- 733
- 11
- 25
0
votes
0 answers
Application won't start when adding function.routing.enabled=true with AWS Kinesis binder
I have a Spring Cloud Stream application where I'm using the AWS Kinesis Binder. I have the following configuration in the application.yml file:
cloud:
stream:
bindings:
customerEvents-out-0:
binder: kinesis
…
Carlos Gonzalez
- 607
- 1
- 5
- 13
0
votes
1 answer
Spring Cloud Stream routing function custom header not present in consumer
I'm following this guide for event routing:
https://docs.spring.io/spring-cloud-stream/docs/3.2.5-SNAPSHOT/reference/html/spring-cloud-stream.html#_event_routing
This is the configuration for the kinesis producer
cloud:
stream:
…
Henry
- 67
- 5