Questions tagged [flatfilereader]

32 questions
6
votes
1 answer

Inject cropped file as input:file value

I am using jQuery Croppie lib for cropping user's uploaded file. When user uploads file, I am opening modal in which user can crop image. After that I want to set this cropped image as file input value so that, user can submit form then when…
Aram810
  • 619
  • 7
  • 21
5
votes
1 answer

How to read flat file header and body separately in Spring Batch

i'm doing a simple batch job with Spring Batch and Spring Boot. I need to read a flat file, separate the header data (first line) from the body data (rest of lines) for individual business logic processing and then write everything into a single…
Fede Lopez
  • 85
  • 2
  • 8
2
votes
1 answer

Spring batch GZIP ItemWriter/ItemReader

I have a Spring boot app, and I wrote some ItemWriter and ItemReaders, for example for JSON files and CSV files. I want to add a step of compressing to GZIP and decompressing from GZIP. I wanted to know if it is possible to do as usual with…
ChikChak
  • 936
  • 19
  • 44
2
votes
3 answers

Unfound resource for FlatFileItemReader after moving the file

I am using Spring Batch to read from a CSV file and write the lines on the screen. My job is composed of 3 parts: Part 1 : Verify if the CSV file exists in some INPUT directory on my disk, if it returns TRUE the file will be moved to another…
Ghassen
  • 591
  • 1
  • 15
  • 33
2
votes
1 answer

Skip number of footer lines in Spring batch

I am using FlatFileItemReader to read a delimited flat file. While I could skip number of headers with field linesToSkip, I wasn't able to skip footers by number of lines.
Anandhan N
  • 23
  • 1
  • 3
1
vote
1 answer

How to create a generic FlatFileItemReader to read CSV files with different headers?

I'm creating a job that will read and process different .csv files based on an input parameter. There are 3 different types of .csv files with different headers. I want to map each line of a file to a POJO using a generic FlatFileItemReader. Each…
1
vote
1 answer

The FlatFileItemReader read only one line from the CSV file - Spring Batch

I'm creating a Spring Batch Job to populate Data into a Database table from a given CSV file. I created a customized FlatFileItemReader. my problem is that the read() method is invoked only one time so only the first line of my CSV file is inserted…
BSL
  • 93
  • 1
  • 10
1
vote
1 answer

How to write this method in a generic way in java

Currently, I have this method implemented for five different class to configure FlatFileReader for five different text files and load into DB table. I would like to know is there a way to implement this method in a common place So that my each file…
Saravanan
  • 11,372
  • 43
  • 143
  • 213
1
vote
1 answer

Spring Batch : How to read footer of CSV file and validation using FlatFileItemReader

I am using Spring Batch and FlatFileItemReader to read a .CSV file. A file have a header(first line), details and footer(last line). So, I want to validate total number of details by a footer line. This is my example .csv…
1
vote
1 answer

Spring batch - How to write data multiple rows after processing single record?

I have bean class as below - public class Account { private String strAccNumber = ""; private List accountList = new ArrayList(); // getter setter .... ... @Override public String toString() { // code for…
yuva ツ
  • 3,707
  • 9
  • 50
  • 78
0
votes
2 answers

How to read a Flatfile in batches [Spring Batch 2.7.8 , Mysql 8]

I have a flat file with 3200000 rows and performance of application decreases as time progresses. For e.g 100000 rows in 30 sec to 320000 in total time of about 4 hours. I am using jdbc template for batch saving . Also tried async read with…
dew025
  • 1
0
votes
0 answers

NextJS - Read Data Once From File and usable in any module

I am trying to implement the following design. Read data from a file (xml) at server startup and have it available as in memory variables to be used in the backend api for certain calculations. This data never changes thus it only need to be read…
0
votes
0 answers

Spring Batch FlatFileItemWriter

salve sto cercando di leggere u oggetto e scivere un oggetto ma ricevo un errore : Invalid property 'KDE22' of bean class [com.Bnl.Wl.Batch2.Model.EmployeeOut]: Bean property 'KDE22' is not readable or has an invalid getter method: Does the return…
0
votes
0 answers

SSIS Read File With No Column Names

Alright so I am not sure how to go about this, I have files that will be coming in a format like this that I need to read into a SQL Server database: As you can see, it is "~" delimited and it contains no columns names at all. I will have multiple…
0
votes
1 answer

Getting error: Invalid number['"] the row will be skipped

We have one mapping source as flatfile and target as oracle table. Source file comma delimited file. In some rows we use to get ' or " enclosed values. We set optional quotes as double in source definition. The session is running fine in 10.2…
1
2 3