Questions tagged [fixed-length-file]

22 questions
23
votes
3 answers

sqlplus spooling: How to get rid of first, empty line?

I'm doing the following spooling statement: SET VERIFY OFF SET FEEDBACK OFF SET HEADING OFF SET TRIMSPOOL ON SET TERM OFF SPOOL &pathRelations START scripts/relations.sql &parent SPOOL OFF SET TERM ON The scripts/relations.sql file contains a…
user321068
16
votes
9 answers

Is there an smart way to write a fixed length flat file?

Is there any framework/library to help writing fixed length flat files in java? I want to write a collection of beans/entities into a flat file without worrying with convertions, padding, alignment, fillers, etcs For example, I'd like to parse a…
Mikhas
  • 851
  • 1
  • 12
  • 31
2
votes
2 answers

Reading data from Fixed Length File into class objects

I have a fixed length file and would like to read its data into class objects. These objects will be further used to insert/update data in Database. Although it can be done with StreamReader, I am looking for a more sophisticated solution.…
IFlyHigh
  • 546
  • 2
  • 9
  • 20
1
vote
1 answer

BeanIO fixed length file writer Scala- Avoid one field from writing

I am trying to write a csv file from scala case class using fixed length file BeanIO library. sample code case class employee(id:String,name:String,dob:String)
1
vote
1 answer

Fixed length parsing in spark scala

I have created the dataframe and the input is like this: +-----------------------------------+ |value | +-----------------------------------+ |1 PRE123 21 | |2 TEST …
Etisha
  • 307
  • 6
  • 16
1
vote
1 answer

how to convert fix length file to csv file in python?

In the file each columns have fix size. Is there any library or function available using that we can convert easily to CSV file ? There are four columns in the file. 1st - 1233212Q1AQYHDVCS1221 2nd - 64342343EDV53234212 3rd - 11123321111124122 4th -…
1
vote
0 answers

Mapforce Flex Text as target to make EDI fixed length file

I need to use Altova Mapforce and it's Flex-Text as a target feature to make a fixed length file. I will be pulling data from two sources--one holds employees, the other holds dependents of the employees. The employees have a certain set of fixed…
Jeff.Clark
  • 599
  • 1
  • 5
  • 27
1
vote
2 answers

Dynamic parsing of fixed text files

I want to build a parser for fixed position text files. What I want to achieve is to make it dynamic so that I could pass an external configuration file containing the format of the file that will be parsed. Example of configuration file to make the…
1
vote
1 answer

Dynamically create a Fixed Length text file with FileHelpers

FileHelpers supports a feature called "RunTime Records" which lets you read a Fixed length text file into a DataTable when you don't know the layout until runtime. Is it possible to use FileHelpers to export a Fixed length file at runtime in the…
Manoj
  • 60
  • 1
  • 7
0
votes
1 answer

Can I use JOLT 'shift' to achieve this and how? Array to map (list to dict) using JOLT

I am transforming a large JSON into a fixed-length csv file, at this stage I've cut down the json with a JOLT Remove and I have used a JOLT Shift to put the remaining parameters into the input provided. I have the output from a previous JOLT 'shift'…
Aziz R.
  • 17
  • 4
0
votes
2 answers

Parsing a Fixed length Flat xml file in spring batch

My XML file looks like below, ABC123411/10/20 XBC128911/10/20 BCD456711/23/22 This is a fixed length flat xml file, and I need to parse this file as For…
0
votes
1 answer

BeanIO how to skip/filter @Group in fixedLength

I'm trying to read a fixedlength file. I want to extract list of Document, but filtered only with RecordHeader (RH) with field value "BB". So skip Document with recordHeader equals: RH20210607AA This is an example of my class…
Giulio Buz
  • 13
  • 4
0
votes
1 answer

Unable to perform select count(*) when using RegexSerde on Hive

I am reading data from a flat file with fixed length, and I applied the following script: CREATE EXTERNAL TABLE `test_table`.`test_data` (test_column1 STRING, test_column2 STRING ) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'…
Kong Yong
  • 13
  • 1
  • 4
0
votes
0 answers

How to skip empty rows using Spring Batch

I'm reading a fixed lenght flatfile with Spring Batch and I would like to skip empty rows and incorrect rows for my batch processing. In the exemple bellow I'm also want to skip rows that starts with the characters "------". Could you please help me…
0
votes
1 answer

Handle null values in mapper property

I'm trying to read a flat file and do some processes. To do that I've defined a mapper. That mapper will assign the values for each property. In the document, the date will be represented with yyMMdd format and it can have "" or 000000 as a null…
1
2