Export dataframe as csv file from google colab to google drive

Question

I want to upload a dataframe as csv from colab to google drive.I tried a lot but no luck. I can upload a simple text file but failed to upload a csv.

I tried the following code:

import pandas as pd
df=pd.DataFrame({1:[1,2,3]})
df.to_csv('abc',sep='\t')
auth.authenticate_user()
gauth = GoogleAuth()
gauth.credentials = GoogleCredentials.get_application_default()
drive = GoogleDrive(gauth)
uploaded = drive.CreateFile({'title': 'sample.csv', 'mimeType':'csv'})
uploaded.SetContentFile('abc')
uploaded.Upload()

Can you explain what is the problem? where did you get stuck? please refer to this https://stackoverflow.com/help/mcve — PinoSan, Dec 22 '18 at 21:18

korakot · Answer 1 · 2020-01-12T00:28:32.093

45

It may be easier to use mounting instead of pydrive.

from google.colab import drive
drive.mount('drive')

After authentication, you can copy your csv file.

df.to_csv('data.csv')
!cp data.csv "drive/My Drive/"

edited Jan 12 '20 at 00:28

answered Dec 23 '18 at 02:20

korakot

37,818
16
123
144

thank you, this works fine, I would just like to know what does the line '!cp data.csv drive/My\ Drive/' do? – Alfredo Lozano Apr 22 '19 at 22:11
2

It copy data.csv from current directory to your gdrive (mounted at drive/My Drive/ ) – korakot Apr 24 '19 at 02:14
1

is it possible to copy the file to the folder the colab file is in? – Johnny V Nov 11 '19 at 14:53

score 23 · Answer 2 · answered Mar 16 '20 at 18:58

Without using !cp command

from google.colab import drive

Mounts the google drive to Colab Notebook

drive.mount('/drive')

Make sure the folder Name is created in the google drive before uploading

df.to_csv('/drive/My Drive/folder_name/name_csv_file.csv')

score 11 · Answer 3 · answered Mar 18 '20 at 04:17

11

# Import Drive API and authenticate.
from google.colab import drive

# Mount your Drive to the Colab VM.
drive.mount('/gdrive')

# Write the DataFrame to CSV file.
with open('/gdrive/My Drive/foo.csv', 'w') as f:
  df.to_csv(f)

answered Mar 18 '20 at 04:17

Justin Braaten

711
7
13

score 6 · Answer 4 · answered Aug 24 '21 at 17:10

6

The other answers almost worked but I needed a small tweak:

from google.colab import drive
drive.mount('drive')

df.to_csv('/content/drive/My Drive/filename.csv', encoding='utf-8', index=False)

the /content/ bit proved necessary

answered Aug 24 '21 at 17:10

Kyle Pennell

5,747
4
52
75

score 2 · Answer 5 · answered Jul 11 '21 at 12:19

2

If you want to save locally then you can use this

f.to_csv('sample.csv')
from google.colab import files
files.download("sample.csv")

answered Jul 11 '21 at 12:19

Rohan

640
7
11

score 1 · Answer 6 · answered May 08 '19 at 21:19

1

If you don't want to work with Pandas, do this:

df_mini.coalesce(1)\
   .write\
   .format('com.databricks.spark.csv')\
   .options(header='true', delimiter='\t')\
   .save('gdrive/My Drive/base_mini.csv')

answered May 08 '19 at 21:19

lfvv

1,509
15
17

Export dataframe as csv file from google colab to google drive

6 Answers6

Linked