Combine List of like DataTables

Question

I know this could be done manually with some hardcoded Linq Joins. However, I would like to come up with an elegant way to do this in bulk due to the high number of .csv files I have.

Code:

var dir = Directory.EnumerateFiles(@"C:\IIP_2\", "*.csv", SearchOption.AllDirectories);
var dtCombined = new DataTable();
var lst = new List<DataTable>();

foreach (var v in dir) { lst.Add(GetCSVRows(v, true)); }

//Take List<DataTable> and combine into dtCombined ????

How can I combine this List into one, possibly with a Lambda statement ?

Thanks in Advance !

score 3 · Accepted Answer · answered Jun 28 '12 at 16:34

3

Would this work for you? You should be able to avoid use the list of DataTables altogether.

foreach (var v in dir) 
{ 
    dtCombined.Merge(GetCSVRows(v, true)); 
}

If you change GetCSVRows to return an IDataReader, you can use Load, which may be faster.

foreach (var v in dir) 
{ 
    dtCombined.Load(GetCSVRows(v, true)); 
}

answered Jun 28 '12 at 16:34

Austin Salonen

49,173
15
109
139

Do you have any suggestions on good csv reader. The one I'm using is throwing type errors on dates ? – bumble_bee_tuna Jun 28 '12 at 19:46
1

@bumble_bee_tuna: I don't but I know there are questions here about it. – Austin Salonen Jun 28 '12 at 19:52

Combine List of like DataTables

1 Answers1