Best way to store a dictionary of which keys are dates and values are a list of strings in python

Question

I need to store a dictionary of which keys are dates and values are a list of strings.

The file was originally stored by matlab in .mat with only around 100MB. When we try to store it in pickle, it become 1G. Are there any good ways to save this dictionary in python?

Could you put an example with your data? – amarynets Sep 05 '17 at 06:20 — amarynets, Sep 05 '17 at 06:20
how did you save it in python? – Quickbeam2k1 Sep 05 '17 at 06:23 — Quickbeam2k1, Sep 05 '17 at 06:23

score 1 · Accepted Answer · answered Sep 05 '17 at 07:03

1

You can serialise the dictionary into json and write it out onto the disk. You'll need to convert the dates into some unambiguous format. If it's too big, you can zip files. Since they're text, they should compress fairly well.

answered Sep 05 '17 at 07:03

Noufal Ibrahim

71,383
13
135
169

Best way to store a dictionary of which keys are dates and values are a list of strings in python

1 Answers1