1

My problem is to get big(250Gb) postgres dump on my local machine.

Its on AWS RDS. I tried to dump it to local machine, but it takes too long, kinda 3+ days. Trying to find a way to dump it into S3 and download from there safely. May be you could suggest more effective way to do that. Will appreciate any kind of help. Thanks!

Manuk Karapetyan
  • 534
  • 4
  • 19

2 Answers2

0

As of my knowledge, aws does not provide a way to backup db into s3

you can take a look into this question and answers,

Export huge database from amazon RDS to local mysql

here is one answer

If the data is that big I would suggest copying the RDS snapshot on S3, as explained here.

Link to documentation to copy snapshot to s3

Shobi
  • 10,374
  • 6
  • 46
  • 82
0

This topic is covered in this StackOverflow thread Exporting a AWS Postgres RDS Table to AWS S3

Another solution would be to spin up an EC2 instance and dump the database to a local EBS volume that is large enough for the following steps. Then chose one of the following:

  1. Compress the DB dump into multiple files and copy to S3 for download. I would use a smart S3 download manager given the size of the database dump.
  2. Export the S3 data using Snowball Export S3 Data. If your Internet connection is not fast enough / reliable enough then Snowball will get you the data.
John Hanley
  • 74,467
  • 6
  • 95
  • 159