0

I have a data frame with 7000,000+ rows. cuz it takes about 2 hours to run the codes in order to get this data frame, I kind of want to export it so that I can import it next time without retuning the codes again.

I am just wondering besides cdv, which I personally think may not be able to handle so many records, is there another way to export the data frame as R does with .rda file?

Thank you so much!

MYjx
  • 4,157
  • 9
  • 38
  • 53
  • Take a look at `to_hdf()` and `to_sql()` methods – CT Zhu Jul 09 '14 at 03:07
  • Thx! Will that be less memory-consuming than cdv? – MYjx Jul 09 '14 at 03:12
  • 1
    Once the data is in RAM as a `pandas` `dataframe`, there is no reason why memory usage should be different. But disk storage is a different story: http://stackoverflow.com/questions/16639877/hdf5-taking-more-space-than-csv – CT Zhu Jul 09 '14 at 03:26

0 Answers0