21

I've got a text file full of records where each field in each record is a fixed width. My first approach would be to parse each record simply using string.Substring(). Is there a better way?

For example, the format could be described as:

<Field1(8)><Field2(16)><Field3(12)>

And an example file with two records could look like:

SomeData0000000000123456SomeMoreData
Data2   0000000000555555MoreData

I just want to make sure I'm not overlooking a more elegant way than Substring().

Update: I ultimately went with a regex like Killersponge suggested:

private readonly Regex reLot = new Regex(REGEX_LOT, RegexOptions.Compiled);
const string REGEX_LOT = "^(?<Field1>.{6})" +
                        "(?<Field2>.{16})" +
                        "(?<Field3>.{12})";

I then use the following to access the fields:

Match match = reLot.Match(record);
string field1 = match.Groups["Field1"].Value;
Colonel Panic
  • 132,665
  • 89
  • 401
  • 465
Chris Karcher
  • 2,252
  • 7
  • 24
  • 31
  • Following library can be used: [https://github.com/borisdj/FixedWidthParserWriter](https://github.com/borisdj/FixedWidthParserWriter) – borisdj Nov 20 '18 at 19:06
  • 1
    [SoftCircuits.FixedWidthParser](https://www.nuget.org/packages/SoftCircuits.FixedWidthParser) is free and makes this very easy. It will also automatically map fixed-width fields to class properties. – Jonathan Wood Jun 17 '22 at 14:19

7 Answers7

34

Use FileHelpers.

Example:

[FixedLengthRecord()] 
public class MyData
{ 
  [FieldFixedLength(8)] 
  public string someData; 

  [FieldFixedLength(16)] 
  public int SomeNumber; 

  [FieldFixedLength(12)] 
  [FieldTrim(TrimMode.Right)]
  public string someMoreData;
}

Then, it's as simple as this:

var engine = new FileHelperEngine<MyData>(); 

// To Read Use: 
var res = engine.ReadFile("FileIn.txt"); 

// To Write Use: 
engine.WriteFile("FileOut.txt", res);
Marcos Meli
  • 3,468
  • 24
  • 29
Leandro Oliveira
  • 477
  • 3
  • 3
8

Why reinvent the wheel? Use .NET's TextFieldParser class per this how-to for Visual Basic: How to read from fixed-width text files.

Colonel Panic
  • 132,665
  • 89
  • 401
  • 465
8

Substring sounds good to me. The only downside I can immediately think of is that it means copying the data each time, but I wouldn't worry about that until you prove it's a bottleneck. Substring is simple :)

You could use a regex to match a whole record at a time and capture the fields, but I think that would be overkill.

Jon Skeet
  • 1,421,763
  • 867
  • 9,128
  • 9,194
  • Yea, I tried to think of a way to use a regex, but think it's the wrong tool for the job and as you said, overkill. – Chris Karcher Oct 02 '08 at 14:59
  • regex? ^(.{8})(.{16})(.*)$ for the above definition of fields, assuming that the last field may or may not be padded out with spaces. – Sekhat Oct 02 '08 at 15:01
2

You may have to watch out, if the end of the lines aren't padded out with spaces to fill the field, your substring won't work without a bit of fiddling to work out how much more of the line there is to read. This of course only applies to the last field :)

Sekhat
  • 4,435
  • 6
  • 43
  • 50
1

Unfortunately out of the box the CLR only provides Substring for this.

Someone over at CodeProject made a custom parser using attributes to define fields, you might wanna look at that.

Jon Limjap
  • 94,284
  • 15
  • 101
  • 152
0

Nope, Substring is fine. That's what it's for.

Will Hartung
  • 115,893
  • 19
  • 128
  • 203
0

You could set up an ODBC data source for the fixed format file, and then access it as any other database table. This has the added advantage that specific knowledge of the file format is not compiled into your code for that fateful day that someone decides to stick an extra field in the middle.

Soraz
  • 6,610
  • 4
  • 31
  • 48