Stack Overflow
Stack Overflow

Questions tagged [spring-batch-integration]

19 questions
3
votes
0 answers

spring Batch process is running automatically even with the spring.batch.job.enabled=false flag

My Goal : Prevent batch Job from lunching while project startup. I want to run a batch job from spring boot project once in every one hour using @scheduled annotation. However the job is starting as soon as I run the…
Santrupta Dash
  • 269
  • 2
  • 15
1
vote
1 answer

How to configure channels and AMQ for spring-batch-integration where all steps are run as slaves on another cluster member

Followup to Configuration of MessageChannelPartitionHandler for assortment of remote steps Even though the first question was answered (I think well), I think I'm confused enough that I'm not able to ask the right questions. Please direct me if you…
pojo-guy
  • 966
  • 1
  • 12
  • 39
1
vote
1 answer

How to use the functional style on my RemoteChunkingManagerStepBuilderFactory?

I am implementing Spring Batch-Integration RemoteChunking. https://docs.spring.io/spring-batch/docs/current/reference/html/spring-batch-integration.html#remote-chunking I've come across the deprecation of @Input and the documentation says we have…
Pascoal Eddy Bayonne
  • 63
  • 7
0
votes
0 answers

Spring Batch 5 Remote Partitioning Using spring-cloud-aws 3.0.1 SQS

I have integrated AWS SQS to run a batch job using spring batch 5 remote partitioning. I have used LocalStack for SQS service. My Worker configuration is working fine and Manager Configuration application is exiting without errors. I have referred…
praneeth
  • 203
  • 1
  • 4
  • 14
0
votes
0 answers

In Spring Batch Integration, the javadoc for MessageChannelPartitionHandler says to make it a job or step scoped bean. How does this work in XML?

Description of problem: In testing, I realized that I had a globally scoped bean "partitionHandler" of type o.s.b.i.p.MessageChannelPartitionHandler that needed to be step scoped. When I followed the examples of the other step scoped beans in the…
pojo-guy
  • 966
  • 1
  • 12
  • 39
0
votes
0 answers

Asynchronous Processor and Synchronous Writer in spring batch

I am writing a spring batch program to generate some Json and write this to a target table.To improve performance, I have used AsyncItemProcessor and AsyncItemWriter, but there are issues in AsyncItemWriter since some of the logics like incrementing…
Pushkala P
  • 3
  • 2
0
votes
0 answers

DeadlockLoserDataAccessException while using AsyncItemWriter

Getting deadlock while using AsyncItemWriter I am using AsyncItemProcessor and AsyncItemWriter to implement parallel processing in spring batch. I am trying to read some data from a table, and processing the data read in multiple threads and after…
Pushkala P
  • 3
  • 2
0
votes
1 answer

Spring Batch remote-partitioning worker-job not reading data from middleware

I wanted to checkout the remote partitioning setup in Spring Batch. I am using Spring Boot v2.7.2 & Kafka as middleware. I have used the ColumnRangePartitioner from the Spring Batch samples I am seeing that the manager job is persisting the metadata…
AbNig
  • 391
  • 1
  • 6
  • 24
0
votes
0 answers

How to delegate Spring Integration Message Payload to Spring Batch Job?

I have an FTP Streaming Inbound Channel Adapter from Spring Integration which produces message with payloads of type InputStream, letting files be fetched without writing to the local file system. @Bean @InboundChannelAdapter(channel =…
Jekshenov Chingiz
  • 15
  • 4
0
votes
1 answer

Spring Batch Integration idle behavior during polling remote SFTP

I'm using Spring Batch Integration for polling and process a SFTP server, we receive thousands of XMLs files (between 50MB ~ 200MB each file). Actually I'm running 6 instances of my app to process those files. Spring:…
Guilherme Bernardi
  • 490
  • 1
  • 6
  • 18
0
votes
1 answer

Spring file integration: Error FileSystemException while writing File using FileWritingMessageHandler

I have created a flow that reads two files as input and copies them to a 'work' directory and then transforms them into a JobRequest. The payload is a JobExecution which contains the two files as parameters. So, I launch the batch then I want to get…
Sana
  • 3
  • 3
0
votes
1 answer

Does Spring Cloud Task supports file listeners?

I have implemented Batch processing with Spring Batch Integration. I’ve achieved the best solutions for file listeners which is way better than scheduler (cron). Now we are migrating to Spring Cloud Task with Dataflow. My question is how can I…
Eddy Bayonne
  • 2,448
  • 1
  • 17
  • 23
0
votes
1 answer

JMS Outbound Gateway - Receiving Replies from two jobs instances

We are using the JMSOutboundGateway to send message and receive message using the reply channel within the JMSOutboundGateway. When we run multiple iterations of the same job using the same JMSOutboundGateway, it fails with this error "Message…
rockycres
  • 71
  • 8
0
votes
1 answer

How to processing multiples large files at same time with multiples instances using Spring Batch Integration?

I created a Spring Batch Integration project for process multiples files and it is working like a charm. While I'm writing this question I have four Pods running, but the behaviour isn't like I'm expecting, I expect 20 files being processing at the…
Guilherme Bernardi
  • 490
  • 1
  • 6
  • 18
0
votes
1 answer

Spring batch integration remote partitioning - running parallel jobs

We have a usecase where we need to read data from some paginated API and write to some downstream Kafka topic. We have been able to implement the solution via spring batch integration remote partitioning where the manager takes care of partitioning…
GauravKumar
  • 46
  • 1
  • 8
1
2