Issues Uploading JSON to s3 using node.js

Question

I am new to amazon s3 and am trying to use node.js to upload JSON into a file. My object is users, and it has a bunch of keys and values in it. Here is how I'm uploading it:

 s3.putObject({Bucket: 'currenteventstest',Key: 'users.json',Body: users, ContentType: "application/json"});

However, when I re download it, it's just an empty object.

Is `users` a JS object, or actual JSON? It should be the latter, so if it's the former, you need to use `JSON.stringify` or something equivalent. — jcaron, Mar 21 '17 at 00:39
I have tried using `JSON.stringify` and it also does not work. — Someone, Mar 21 '17 at 00:53
Please show the relevant code, including sample content of `users`. Also, have you checked the result of your `putObject` call? You should add event handlers for `success` and `error`, and log details. — jcaron, Mar 21 '17 at 00:58

score 16 · Accepted Answer · edited Nov 08 '18 at 16:33

16

Adding a callback function fixes the problem:

s3.putObject({
  Bucket: 'currenteventstest',
  Key: 'users.json',
  Body: JSON.stringify(users),
  ContentType: "application/json"},
  function (err,data) {
    console.log(JSON.stringify(err) + " " + JSON.stringify(data));
  }
);

edited Nov 08 '18 at 16:33

jansepke

1,933
2
18
30

answered Jun 06 '17 at 00:32

Someone

800
1
7
25

I've got something similar going on but keep getting `Cannot read property 'Location' of undefined` – Tomos Williams Mar 25 '19 at 15:57

Kai Durai · Answer 2 · 2020-07-28T18:18:27.113

8

I don't have enough reputation to comment, but for what its worth with the new aws-sdk version you can use the promise chain when posting the JSON instead of a callback:

try{
   await s3.putObject({
        Bucket: 'currenteventstest',
        Key: 'users.json',
        Body: JSON.stringify(users),
        ContentType: 'application/json; charset=utf-8'
    }).promise();
}
catch(e){
   throw e
}

edited Jul 28 '20 at 18:18

answered Jun 24 '20 at 20:56

Kai Durai

371
3
10

score 0 · Answer 3 · answered Mar 31 '20 at 08:02

JSON.stringify is the way to create a JSON file on S3.

AWS accepts serialized JSON string as Body.

s3.putObject({
    Bucket: 'currenteventstest',
    Key: 'users.json',
    Body: JSON.stringify(users),
    ContentType: 'application/json; charset=utf-8'
});

score 0 · Answer 4 · answered Feb 21 '22 at 07:22

0

I had an ES6 Map in my data, which gets stringified to empty by default. I had to refer to below answer to address the issue by manually adding a replacer function to the JSON.Stringify

How do you JSON.stringify an ES6 Map?

answered Feb 21 '22 at 07:22

John Smith

1
1

1

Your answer could be improved with additional supporting information. Please [edit] to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers [in the help center](/help/how-to-answer). – Community Feb 21 '22 at 08:25

Issues Uploading JSON to s3 using node.js

4 Answers4

Linked