Questions tagged [kinesis-stream]

Amazon Kinesis-stream is a fully managed service for real-time processing of streaming data at massive scale.

8 questions
1
vote
1 answer

In dynamodb, what is the difference between using dynamo streams + lambda trigger versus kinesis streams + lambda trigger?

I am looking into dynamo db streaming options. There are 2: Dynamo streams Kinesis streams Dynamo streams can have a lambda trigger that will consume the stream. Kinesis streams can also have the lambda trigger that will consume the stream. In…
1
vote
1 answer

Unable to load AWS Credentials

I am following the next example to connects to Amazon Kinesis Data Streams and outputs the joined results to Amazon S3 in parquet format: https://docs.aws.amazon.com/glue/latest/dg/glue-etl-scala-example.html When I configure the connection to AWS…
0
votes
1 answer

Spark structured streaming - Kinesis stream

Does Spark supports structured streaming with Kinesis stream as data source? It appears Databricks version supports - https://docs.databricks.com/structured-streaming/kinesis-best-practices.html. However does Spark outside of Databricks support…
0
votes
1 answer

Is spring-cloud-stream-binder already supports using Kinesis enhanced fan-out?

I can't find any documentation that explains how to integrate with Kinesis enhanced fan-out. Still, is there such a possibility? example of my configuration: spring: clouds: streams: bindings: consumeRequest-in-0: …
Pumiki
  • 3
  • 2
0
votes
1 answer

Can an AWS EventBridge Rule target a Kinesis Data Stream (with a custom event, not AWS event)?

In EventBridge I have an Event Bus with 2 Rules. In Kinesis I have a Data Stream. One of the Rules has as a Target a Log Group in CloudWatch. The second Rule has as a Targe my Data Stream in Kinesis. This Rule has a Role with a Policy to execute all…
0
votes
0 answers

Kafka-Kinesis-Connector Commit of offsets threw an unexpected exception for sequence number: null

I have a java project which is using Kafka-Kinesis-Connector as a connector used with Kafka Connect to publish messages from Kafka to Amazon Kinesis Stream which in turn triggers Lambda. The service we had was using kafka kinesis client 1.7.3 lib…
0
votes
1 answer

Apache Flink, KineisStreamSink PKIX path building failed

I have a local Kinesalite stream, which I try to send data from my local Kinesis, built in application mode: Properties sinkProperties = new Properties(); sinkProperties.put(AWSConfigConstants.AWS_REGION, region); …
ForestG
  • 17,538
  • 14
  • 52
  • 86
0
votes
1 answer

Android: I tried AWS Kinesis video streaming but getting exception?

I tried AWS Kinesis, and I am able to create stream but when I try to put stream in this file I am getting an exception "Exception thrown on sending thread: Exception while sending encoded chunk in MKV stream!" Please help me to proceed with…