File upload Amazon very Slow using Django storages

Question

I am using Django-Storages for file upload to Amazon S3 but the upload speed is very slow.

Is there any way I can get nice upload speed ?

I am using

Django == 1.4

Django-storages == 1.1.8

boto == 2.6.0

Django settings:

DEFAULT_FILE_STORAGE = 'storages.backends.s3boto.S3BotoStorage'

AWS_ACCESS_KEY_ID = 'XXXXXXXXX'

AWS_SECRET_ACCESS_KEY = 'XXXXXXX'

AWS_STORAGE_BUCKET_NAME = 'XXXdev'

AWS_QUERYSTRING_AUTH = False

We need your internet speed like Priyank suggests and we could also use how big all the files you're trying to send up are together. — stormlifter, Mar 11 '14 at 19:51
Should I use Browser based uploads using Post, to upload files directly to S3, to speed up the uploads ? — user1839132, Mar 12 '14 at 06:12
The django-stroages boto connection seems extremely slow, same problem here, still looking for solution — Wade Williams, Apr 02 '14 at 03:11
This fix seems ligit: http://stackoverflow.com/questions/20700890/files-served-unbearably-slow-from-amazon-s3 — Wade Williams, Apr 02 '14 at 03:13

score 0 · Answer 1 · answered May 11 '14 at 12:22

I don't think django is influencing a lot in here. you can upload or download directly from S3 via the browser and see it is also not so fast. If you upload from EC2 to S3, the fastest way is if the EC2 & S3 are on the same region. Also, The fastest way is when your using the closest region from you. (PC ==> EC2 ==> S3).

I read once this article, was a nice one: http://www.takipiblog.com/2013/03/20/aws-olypmics-speed-testing-amazon-ec2-s3-across-regions/

File upload Amazon very Slow using Django storages

1 Answers1