Use pandas.read_csv to read files containing str() in file's name

Question

I am trying to use pandas.read_csv to read files that contain the date in their names. I used the below code to do the job. The problem is that the files name is not consistent as the number of date change the pattern. I was wondering if there is a way to let the code read the file with parts of the name is the date in front of the file name?

for x in range(0,10):
dat = 20170401+x
dat2 = dat+15
file_name='JS_ALL_V.'+str(dat)+'_'+str(dat2)+'.csvp.gzip'
df = pd.read_csv(file_name,compression='gzip',delimiter='|')

Can you read file names using "names = [os.path.basename(x) for x in glob.glob('/your_path')]" , now pass file name one by one in pd.read_csv — Vipin, Sep 22 '18 at 07:44
@Vipin it seems like glob.glob('*.csvp.gzip') is not working. the file type maybe not supported — AOJ keygen, Sep 22 '18 at 08:16
what is the error, please provide your code snippet and error. — Vipin, Sep 22 '18 at 08:37
@Vipin It is all good now. I just made some typo in my code. Thank you. — AOJ keygen, Sep 22 '18 at 10:51

score 1 · Answer 1 · answered Sep 22 '18 at 08:34

1

An alternative of using glob.glob() (since it seems not working) is os.listdir() as explained in this question in order to have a list containing all the elements (or just the files) in your path.

answered Sep 22 '18 at 08:34

toom501

324
1
3
15

score 1 · Accepted Answer · answered Sep 22 '18 at 11:38

1

You can use glob library to read file names in unix style

Below is its hello world:

import glob
for name in glob.glob('dir/*'):
    print name

answered Sep 22 '18 at 11:38

Vipin

4,851
3
35
65

Use pandas.read_csv to read files containing str() in file's name

2 Answers2