I want to save my scrape record in csv, this Python Code working fine for me but it's making extra columns each time new data is saved

Question

it's making extra columns for each time new data is saved in this sheet How can I stop making extra columns?

Data = [[Category,Headlines,Author,Source,Published_Date,Feature_Image,Content,url]]

cols = ['Category','Headlines','Author','Source','Published_Date','Feature_Image','Content','URL']
try:
    opened_df = pd.read_csv('C:/Users/Public/pagedata.csv')
    opened_df = pd.concat([opened_df,pd.DataFrame(Data, columns = cols)])
except:
    opened_df = pd.DataFrame(Data, columns = cols)

opened_df.to_csv('C:/Users/Public/pagedata.csv')

https://stackoverflow.com/questions/20845213/how-to-avoid-pandas-creating-an-index-in-a-saved-csv, I guess. — BigBen, Oct 05 '22 at 18:12

Echo · Accepted Answer · 2022-10-05T18:17:09.747

1

Try this in your last line of your code:

opened_df.to_csv('C:/Users/Public/pagedata.csv', index = False)

in case the "Unnamed: 0" gets created everytime and is an unwanted column in your csv try this, before the last line in your code:

opened_df.drop('Unnamed: 0', axis = 1, inplace = True)
opened_df.to_csv('C:/Users/Public/pagedata.csv', index = False)

i hope this solves your issue.

edited Oct 05 '22 at 18:17

answered Oct 05 '22 at 18:12

Echo

293
2
10

Thanks, it's working Perfect by just replacing the last line with your line. – Info Rewind Oct 05 '22 at 18:21

I want to save my scrape record in csv, this Python Code working fine for me but it's making extra columns each time new data is saved

1 Answers1