Stack Overflow
Stack Overflow

Questions tagged [apache-camel-aws]

37 questions
4
votes
1 answer

What is the best way to host Apache Camel in AWS?

As we move our workloads to AWS I am looking for an ETL tool which is widely used and has the appropriate connectors - Apache Camel appears to fit the bill. However, I am struggling to find information on how Camel can be deployed in AWS - the…
Peter
  • 5,455
  • 7
  • 46
  • 68
2
votes
1 answer

Keep the filename and filetype in AWS S3 upload using Camel

Being a beginner with AWS and S3, i was trying to integrate to upload a Sample.txt file from my local sftp to s3 using apache camel
codeforHarman
  • 115
  • 1
  • 10
2
votes
0 answers

How to download zip file from http with camel?

I am a beginner with Camel. I am trying to download a zip file for which I have http path and trying to store the file in the local file system. I managed to read the file but instead of reading it once and downloading it in local folder my code is…
saram
  • 29
  • 2
2
votes
1 answer

Using Apache Camel AWS-KINESIS endpoint, how do I checkpoint the message in the Kinesis stream?

I use AWS-KINESIS endpoint in Camel to read from a AWS Kinesis contentstream. I can read messages just fine, but how do I checkpoint the message on the stream? In the standard AWS Kinesis Java client library you have the concept of Workers and…
DKIT
  • 3,471
  • 2
  • 20
  • 24
1
vote
0 answers

1,000,000 files consumption with doneFileName(1:1) multi-threading issue

As part of a performance scenario, my route is consuming 1,000,000 files off an AwsLinux EBS volume. MaxMessagesPerPoll is set at 100, route threads set at 10. A done file is generated for each document. The route can successfully consume all…
Panther-L7-AttackMech
  • 11
  • 1
1
vote
0 answers

How to generate header using SoapJaxbDataFormat

First I have generated pojo class using jsonschema2pojo plugin using WSDL file. My WSDL file contains Header and Body. Body Root Pojo looks like this: public class SubmitCustomerOrderRequest { @XmlElement(required = true) protected…
Sandeep
  • 11
  • 1
1
vote
0 answers

Camel aws-s3 Source Connector Error - How should the config be changed

I am working on defining a Camel S3 Source connector with our Confluent (5.5.1) installation. After creating the connector and checking status as "RUNNING", I upload a file to my S3 bucket. Even if I do ls for the bucket, it is empty, which…
adbdkb
  • 1,897
  • 6
  • 37
  • 66
1
vote
0 answers

How to implement Apache Camel Dynamic Router Pattern for flow chart based execution process

How to implement Apache Camel Dynamic Router Pattern, for flow chart based execution process. I have been through the links https://www.javainuse.com/camel/camel-dynamic-router-example, could not able to figure it out. I want to create an API that…
Braj Ankit
  • 333
  • 1
  • 2
  • 19
1
vote
1 answer

How to send a message MessageGroupID and MessageDeduplicationID to amazonSQS using camel-aws

Could we send a message to Amazon SQS "FIFO" queue using the Java-DSL syntax: from("..")..to("aws-sqs://testSQSFifo.fifo?amazonSQSClient=#amazonSQSClient); Keep in mind that: this is a FIFO queue, so it needs MessageGroupID and…
Minh Pham
  • 13
  • 5
1
vote
2 answers

Splitting a Json Array with Camel

I have a camel route that takes a String object of json, calls a bean to strip out a JSONArray of players. from("direct:players").routeId("player_route") .bean(BootstrapStaticParser.class,"getPlayersList") .split(body()) …
user2167744
1
vote
2 answers

Is Apache Camel available in AmazonMQ?

Disclaimer: I did post this on Server Fault, first, and the replies there were: I'm voting to close this question as off-topic because we are not AWS support. This question does not appear to be about server, networking, or related…
ps2goat
  • 8,067
  • 1
  • 35
  • 68
1
vote
2 answers

How to read S3 file only once in Apache Camel

My DSL start is something like this: from("aws-s3://" + s3_bucket_name + "?amazonS3Client=#amazonS3Client&deleteAfterRead=false&fileName=myfile.csv") after this I covert each row into a JSON file and dump into a local directory. The problem is it…
rockoder
  • 747
  • 11
  • 23
1
vote
1 answer

Apache Camel: How to stream large files from AWS?

I have a route as follows. It works for small files, but for large ones (around 6GB or more), my program runs out of memory. How do I stream the content without storing in memory? public void configure() throws Exception { S3LastModifiedFilter…
Abhijit Sarkar
  • 21,927
  • 20
  • 110
  • 219
0
votes
0 answers

I am replacing my Spring boot camel rest api to AWS Lambda. I am getting NullPointerException

In local while testing it running properly but during Lamda testing getting below error: Caused by: java.lang.NullPointerException: null at org.apache.cxf.jaxrs.client.AbstractClient.setupOutInterceptorChain(AbstractClient.java:937) ~[task/:na] at…
Nairiti Singha Roy_UNC
  • 11
  • 1
0
votes
1 answer

How to make sure that apache camel pick one message at a time from AWS SQS?

Recently I was debugging an application and found out my Apache camel consumer is picking two message at a time and processing them. I debugged and found out that apache camel is creating two threads even though it is specified to have one thread…
Akhil Thakur
  • 1
  • 1
1
2 3