26

Is there an open-source equivalent to the Amazon S3 storage service running under Linux?

For example a bucket-based file system like:

  • store file -> get unique id
  • access file by unique id
  • delete file by unique id
  • query files by timestamp
  • ...

Thanks.

Steffen Opel
  • 63,899
  • 11
  • 192
  • 211
hberg539
  • 447
  • 1
  • 4
  • 10
  • 2
    Since I can't add an answer, I write this comment: Minio is an Amazon S3 compatible object storage server. https://minio.io – guettli Nov 29 '16 at 09:45

3 Answers3

11

Riak CS is a new Amazon S3 API-compatible product for your own cloud. It's not open-source, but it may be a viable alternative for your consideration.

Well Actually
  • 1,723
  • 1
  • 18
  • 28
9

OpenStack also does object storage.

There was also Eucalyptus, but that seems to be dead.

Frodo Baggins
  • 8,290
  • 6
  • 45
  • 55
6

Thank you for your answers and sorry for not being clear about my problem.

Currently i have about 4TB of image files spread over 3 servers. My application spreads these files randomly. On which server the file is located, is stored at the mysql database (replicated to each of these servers). The image files are served by nginx and php directly from these servers (no proxy). When one of these servers crashes, i have no failover and no redundancy. Of course i can recover anything from backups, but 1 to 1.5TB of data on each server need much time to recover.

After a bit of research, i found MogileFS as the optimal solution.

hberg539
  • 447
  • 1
  • 4
  • 10