1

I am wondering if anyone has tried using compression techniques for their LMDB files? Typically, lmdb files typically do not use any compression. I am wondering if anyone has successfully stored data in an lmdb using jpeg compression on lmdb and then used it for caffe. I need this because I am working on a developer board with very limited storage space. If so, can you please provide steps/code to do this?

thanks

ypx
  • 1,459
  • 11
  • 19
jerpint
  • 399
  • 2
  • 16
  • have you considered using `--encoded_type jpg` in [`convert_imageset`](http://stackoverflow.com/questions/31427094/guide-to-use-convert-imageset-cpp)? – Shai Jun 07 '16 at 07:15
  • I am considering it, just wondering if anyone has experience using it, and if I need an extra decode step afterwards – jerpint Jun 07 '16 at 17:34
  • afaik, you do not need anything special afterwards – Shai Jun 07 '16 at 17:35
  • 1
    ok thank you @Shai, if i go down that route i will update this post – jerpint Jun 08 '16 at 03:15

1 Answers1

1

Caffe also supports HDF5 which supports compression. If your dataset is smth like mnist - it may be a good choice.

Илья Ефимов
  • 108
  • 8