How to concat multiple csv files into 1 file

Question

I am trying to concat multiple csv files into 1 file using python3. How can i do this. All the csv files in the same folder. When i used glob it gives me an error.

import glob
import csv

newfile = glob.glob('C:\Users\perera\Desktop\Machine Learning\RYU\data\dataset_1\*.csv')

and the error is

(unicode error) 'unicodeescape' codec can't decode bytes in position 2-3: truncated \UXXXXXXXX escape

what is the problem here

on linux: `$ cat *.csv > combined.csv`. there must be something similar on windows... — hiro protagonist, Jul 03 '19 at 07:43
Add raw string --> `r'C:\Users\perera\Desktop\Machine Learning\RYU\data\dataset_1\*.csv'` — Rakesh, Jul 03 '19 at 07:45
...or use / as a directory separator (though a raw string is probably better) — cdarke, Jul 03 '19 at 07:48

Stop harming Monica · Answer 1 · 2019-07-03T09:15:30.430

3

\U within a string literal is interpreted as an escape sequence. Use a raw literal to avoid parsing of escape sequences.

newfile = glob.glob(r'C:\Users\perera\Desktop\Machine Learning\RYU\data\dataset_1\*.csv')

edited Jul 03 '19 at 09:15

answered Jul 03 '19 at 07:46

Stop harming Monica

12,141
1
36
56

score -1 · Answer 2 · edited Jul 03 '19 at 08:32

-1

import pandas as pd;
import os;

frame = pd.DataFrame()
df = pd.concat([pd.read_csv(f'dir/{f}') for f in os.listdir('dir') 
if f.endswith('.csv')])

edited Jul 03 '19 at 08:32

Rohit.007

3,414
2
21
33

answered Jul 03 '19 at 08:14

Priyanka Bangale

1
1

How to concat multiple csv files into 1 file

2 Answers2