nodejs mongoose bulk update

Question

I have a collection of documents and I need to add a new field for ever document. If I run a query to get all documents and then update every single one node.js is stopped, may be for memory leak

This is my code

var express = require('express');

var geocoderProvider = 'google';
var httpAdapter = 'http';

var People = require("./models/people").collection.initializeOrderedBulkOp();

var app = express();

var geocoder = require('node-geocoder').getGeocoder(geocoderProvider, httpAdapter, {});

app.get('/', function (req, res) {
  People.find({}, function (err, docs) {
    if (err) {
      res.send(err);
    }else{
      docs.forEach( function (doc){
        geocoder.geocode({address: doc.address, country: 'Italy', zipcode: doc.cap}, function(error, value) {
          doc.loc.coordinates[0]=value[0].latitude;
          doc.loc.coordinates[1]=value[0].longitude;
          People.update({ _id: doc._id }, { $set: { loc: doc.loc }}, { multi: true }, function (error){
            if(error){
              console.error('ERROR!');
            }
          });
        });
      });
    }
  });
});

var server = app.listen(3000, function () {
  var host = server.address().address
  var port = server.address().port
  console.log('Example app listening at http://%s:%s', host, port)
});

There is any way to bulk update with mongoose? Thanks in advance

you should look at using stream - you can then pause, make a change, save, then resume the stream - edit: mongo only allows atomic changes (ie one doc change at a time - so no there's no bulk change) — Dave Briand, Jan 29 '15 at 15:36
It doesn't look to me like node.js should "stop" while updating your documents. With regards to bulk updating with mongoose, MongoDB does not support multi-document transactions. If you'd like to implement something close, look at http://stackoverflow.com/questions/12493576/multi-collection-multi-document-transactions-in-mongodb — influxd, Jan 29 '15 at 15:53

score 24 · Answer 1 · answered Apr 22 '15 at 19:40

More detailed info about the query and update query.

var bulk = People.collection.initializeOrderedBulkOp();
    bulk.find(query).update(update);
    bulk.execute(function (error) {
       callback();                   
    });

Query is searching with array.
Update needs a $set

var bulk = People.collection.initializeOrderedBulkOp();
    bulk.find({'_id': {$in: []}}).update({$set: {status: 'active'}});
    bulk.execute(function (error) {
         callback();                   
    });

Query is a searching the id

var bulk = People.collection.initializeOrderedBulkOp();
    bulk.find({'_id': id}).update({$set: {status: 'inactive'}});
    bulk.execute(function (error) {
         callback();                   
    });

jtmarmon · Answer 2 · 2017-04-08T21:36:32.850

You can drop down to the collection level and do a bulk update. This action will not be atomic - some of the writes can fail and others might succeed - but it will allow you to make these writes in a single round trip to your database.

It looks like this:

var bulk = People.collection.initializeUnorderedBulkOp();
bulk.find({<query>}).update({<update>});
bulk.find({<query2>}).update({<update2>});
...
bulk.execute(function(err) {
    ...
});

Check out the docs here: http://docs.mongodb.org/manual/core/bulk-write-operations/

score 7 · Answer 3 · answered Apr 03 '20 at 18:56

This example should include all the cases that we can mix together using directly with Mongoose bulkWrite() function:

Character.bulkWrite([
  {
    insertOne: {
      document: {
        name: 'Eddard Stark',
        title: 'Warden of the North'
      }
    }
  },
  {
    updateOne: {
      filter: { name: 'Eddard Stark' },
      // If you were using the MongoDB driver directly, you'd need to do
      // `update: { $set: { title: ... } }` but mongoose adds $set for
      // you.
      update: { title: 'Hand of the King' }
    }
  },
  {
    deleteOne: {
      {
        filter: { name: 'Eddard Stark' }
      }
    }
  }
]).then(res => {
 // Prints "1 1 1"
 console.log(res.insertedCount, res.modifiedCount, res.deletedCount);
});

Official Documentation: https://mongoosejs.com/docs/api.html#model_Model.bulkWrite

nodejs mongoose bulk update

3 Answers3

Linked