Stack Overflow
Stack Overflow

Questions tagged [amazon-kinesis-agent]

32 questions
6
votes
0 answers

How to fetch the audio file from Kinesis Video stream created from Amazon connect in proper format?

I am trying to setup a VOICE MAIL feature for the callcenter in Amazon connect.I have added the Start Media streaming block to the flow.I have also added a Lambda function which is triggered by the Kinesis stream.My idea is NOT to do a Live…
James_RajKumar
  • 201
  • 3
  • 12
5
votes
1 answer

How to decode AWS Kinesis Video Stream GetMedia API output to mp3/wav?

I ingested data to (Kinesis Video Stream) KVS via AWS Connect service now using GetMedia API am able to extract the Payload but how can I convert this output to a mp3/wav ? I want to ingest this output to AWS Transcribe service to get text format of…
sudhir tataraju
  • 1,159
  • 1
  • 14
  • 30
5
votes
0 answers

KCL consumer not processing records

I've gone through several issues and SO questions and haven't been able to get the sample app to work. Here's how to reproduce this; git clone https://github.com/awslabs/amazon-kinesis-client-python.git cd amazon-kinesis-client-python # Start…
Jonathan
  • 10,792
  • 5
  • 65
  • 85
4
votes
0 answers

Kinesis Agent - Processing JSON /XML Input Source files

My input files are XML or JSON, I was needing help in determining how to configure the agent to process these? As such its a multiline record, with 1 XML/JSON object per input file. No preprocessing is needed As these multi-line records, how best…
Kurt Maile
  • 1,171
  • 3
  • 13
  • 29
3
votes
2 answers

Kinesis Firehose Putrecordbatch example

I am looking for an example to send multiple records to kinesis streams using putrecordbatch. I am currently using putrecord command in the following way to send records to kinesis streams. aws firehose put-record --delivery-stream-name…
Srivignesh KN
  • 452
  • 8
  • 22
2
votes
1 answer

AWS Kinesis - Kinesis Agent not parsing records

I've created a kinesis stream, installed a kinesis agent on my EC2 instance and configured it to read files from a certain directory. Kinesis Agent Configuration file: { "cloudwatch.emitMetrics": true, "kinesis.endpoint":…
PickleRick
  • 31
  • 4
2
votes
1 answer

Configure Proxy under AWS KinesisAsyncClient in java

I need to configure proxies for the Kinesis client. Currently I m using KinesisAsyncClient object for performing async operations on the kinesis stream. After a bit of a search over internet, I came to a conclusion that there is no proper resource…
Hidden Coder
  • 55
  • 3
2
votes
1 answer

Problem writing data to S3 with Kinesis Firehose Delivery Stream from Kinesis Data Stream source

I'm sending JSON files with the Kinesis Agent (using a Docker image) to to Kinesis Data Stream, which then acts as a source for the Kinesis Firehose Delivery Stream, which should then write the files to S3, but nothing is appearing in S3. The JSON…
Karri
  • 188
  • 2
  • 11
2
votes
1 answer

Kinesis Agent reports error from python stream data

Am trying to create a simple stream data from a python code, being appended to a log file, and load the streaming data to a Redshift cluster using a Kinesis Agent->Kinesis Firehose. I confirm that the python code is running fine, creates streaming…
Yuva
  • 2,831
  • 7
  • 36
  • 60
1
vote
1 answer

How do I setup AWS Kinesis Data Stream which gets data from an existing API?

I currently have a GET API endpoint which gives me realtime data of an object. I want to set up AWS Kinesis Data Stream such that it requests data from the API every 5 seconds and directs the output to AWS RDS. How do I get kinesis to query the API…
indrajitt
  • 35
  • 4
1
vote
2 answers

cannot read kinesis stream with flink, getting SdkClientException: Unable to execute HTTP request: Current token (VALUE_STRING)

I am trying to read kinesis (actually running a local mocking with kinesa) from flink. This is my consumer configuration : val consumerConfig = new Properties() consumerConfig.put(AWSConfigConstants.AWS_REGION, "us-east-1") …
igx
  • 4,101
  • 11
  • 43
  • 88
1
vote
1 answer

Consume records from specific shards under KCL 2.x ( Kinesis )

I have set of records under some specific shards in the Kinesis stream. I m using KCL 2.x consumer to consume records from kinesis, but the issue is that consumer is fetching me records from all the shards available in the stream. So is there any…
Hidden Coder
  • 55
  • 3
1
vote
1 answer

How to encrypt the in-transit data movement between data source and kinesis firehose?

I am building an architecture in which real-time data will be ingested into the kinesis firehose using kinesis agent. My data source is on-premise so it requires that the data should be encrypted in-transit. Which protocol is used while data is…
Sains
  • 457
  • 1
  • 7
  • 19
1
vote
0 answers

How to send XML files to Kinesis Firehose data stream

I have a data source which generates XMLs in real time. While checking the Kinesis Firehose integration using kinesis agent for the real time analytics of this XML, I found that Kinesis agent considers each line in the source file as a single…
Sains
  • 457
  • 1
  • 7
  • 19
1
vote
2 answers

IllegalArgumentException: Expected a profile definition on line 1 in KinesisClient

I m creating an object of KinesisClient class using AWS SDK 2.x in java like this AwsCredentialsProvider credentialsProvider = StaticCredentialsProvider.create( AwsBasicCredentials.create("access-key", "secret-key") ); …
Random Coder
  • 13
  • 6
1
2 3