Questions tagged [spring-integration-aws]

Spring Integration Extension for Amazon Web Services.

The full explanation can be found on project github page

122 questions
6
votes
4 answers

Unable to load AWS credentials from any provider in the chain Spring Cloud Stream Kinesis binder

I am not able to connect to AWS kinesis in Spring Cloud Stream Kinesis binder (1.2.0.RELEASE) without using the default configuration at the system level. Only if the system has already been configured to use the default profile and the access key…
Ali
  • 1,759
  • 2
  • 32
  • 69
3
votes
1 answer

Launch JobLaunchRequest for each new file in AWS S3 with Spring Batch Integration

I'm following the docs: Spring Batch Integration combining with the Integration AWS for pooling the AWS S3. But the batch execution per each file is not working in some situations. The AWS S3 Pooling is working correctly, so when I put a new file or…
3
votes
1 answer

Spring Integration + SQS - retry on exception doesn't work

I'm working on integrating Spring Integration with AWS SQS queue. I have an issue when my method annotated with @ServiceActivator throws an exception. It seems that in such cases the message is removed from the queue anyway. I've configured…
3
votes
2 answers

Placing file inside folder of S3 bucket

have a spring boot application, where I am tring to place a file inside folder of S3 target bucket. target-bucket/targetsystem-folder/file.csv The targetsystem-folder name will differ for each file which will be retrived from yml configuration…
3
votes
2 answers

Could somebody provide en example of spring-integration-aws SQS usage?

Here is spring-integration-aws project. They provide example about Inbound Channle adapter: @SpringBootApplication public static class MyConfiguration { @Autowired private AmazonSQSAsync amazonSqs; @Bean public PollableChannel…
2
votes
3 answers

Sync S3 Bucket and listen for changes

I've got an AWS S3 bucket, where I place on a weekly basis a new ZIP file. I want to add a functionality to my existing Web Service, written with Spring Boot: synchronize the bucket locally and watch for changes. For the time being, synchronization…
joninx
  • 1,775
  • 6
  • 31
  • 59
2
votes
0 answers

How to have multiple, concurrent SqsMessageDrivenChannelAdapter polling queue?

I'm experiencing some really bad throughput issues with spring-integration-aws's SqsMessageDrivenChannelAdapter, which is Spring Integration abstraction around spring-cloud-aws's SimpleMessageListenerContainer. The issue, it seems, is that…
user10793234
2
votes
1 answer

Working example for Spring Integration + Amazon SQS queue

I'm looking for a working example of a Spring app that receives and sends messages to a queue using Spring Integration + Amazon SQS service.
2
votes
1 answer

java.lang.IllegalStateException: Connection pool shut down exception from spring-integration-aws library

We are using spring-integration-aws-2.0.0 for connecting to kinesis to listen to stream. While stopping the application, always getting the following exception. a.i.k.KinesisMessageDrivenChannelAdapter : Got an exception…
2
votes
0 answers

InboundChannelAdapter picks up the same file several times from s3

I have InboundChannelAdapter configured with S3StreamingMessageSource. I forced Poller to use taskExecutor with only 1 thread. But I see the same file is being picked up by the same thread 3 times with 3-4 seconds interval. Even though poller…
2
votes
1 answer

Spring cloud stream Special Chars in Message received from kinesis

When I consume the message from kinesis stream. I get some junk chars with headers etc @StreamListener(Processor.INPUT) public void receive(String message) { System.out.println("Message recieved: "+message); throw new…
2
votes
1 answer

Consume messages from Input stream at fixed intervals

I am using stream listener to consume the messages from amazon kinesis stream. @StreamListener(Processor.Input) public void receiveMessage(String message) { //process } Is it possible to implement a listener which will get all the messages…
Patan
  • 17,073
  • 36
  • 124
  • 198
2
votes
1 answer

NPE when trying to Poll S3 using spring-integration-aws S3StreamingMessageSource

I'm trying to poll an S3 object store using S3StreamMessageSource following the example here (under Streaming Inbound Channel Adapter): https://github.com/spring-projects/spring-integration-aws/tree/v1.1.0.RELEASE @Bean @InboundChannelAdapter(value…
2
votes
1 answer

Set S3 bucket dynamically using S3 Message Handler and Spring Integration

How can I pass in an 'asset' POJO to the S3MessageHandler using Spring Integration and change the bucket? I would like to be able to change the bucket, based on a folder in the asset, to something like 'root-bucket/a/b/c.' Each asset can potentially…
KJQ
  • 447
  • 1
  • 7
  • 28
2
votes
1 answer

Spring Integration Usage and Approach Validation

I am testing out using Spring Integration to tie together disperate modules within the same Spring-Boot application, for now, and services into a unified flow starting with a single-entry point. I am looking for the following clarifications with…
1
2 3
8 9