C# mongodb driver 2.0 - How to upsert in a bulk operation?

Question

I migrated from 1.9 to 2.2 and reading the documentation I was surprised to discover that is not possible to upsert during a bulk operation anymore, since operations don't allow options.

bulkOps.Add(new UpdateOneModel<BsonDocument>(filter, update));
collection.BulkWrite(bulkOps);

Should be

options.isUpsert = true;
bulkOps.Add(new UpdateOneModel<BsonDocument>(filter, update, options));
collection.BulkWrite(bulkOps);

Is this work in progress, intended, or I'm missing something? Thank you.

score 36 · Accepted Answer · edited Aug 05 '22 at 10:36

36

Set the IsUpsert property of the UpdateOneModel to true to turn the update into an upsert.

var bulkOps = new List<WriteModel<BsonDocument>>();
// Create and add one or more write models to list
var upsertOne = new UpdateOneModel<BsonDocument>(filter, update) { IsUpsert = true };
bulkOps.Add(upsertOne);
// Write all changes as a batch
collection.BulkWrite(bulkOps);

edited Aug 05 '22 at 10:36

Markus

20,838
4
31
55

answered Feb 28 '16 at 21:39

JohnnyHK

305,182
66
621
471

This should be added to documentation. Thank you!! – Adrian Lopez Feb 28 '16 at 21:47
1

what is bulkOps? How do I get one? – gyozo kudor Nov 09 '17 at 09:25
4

@gyozokudor bulkOps is `List>` – Mathias Apr 12 '18 at 05:46
4

What should I put in `filter`and `update` variables? – gsubiran Apr 24 '19 at 14:34
1

When your Id is a string, this does not work. – irperez Sep 12 '22 at 15:20

Aviko · Answer 2 · 2018-03-21T14:04:30.967

34

given mongo collection

IMongoCollection<T> collection

and enumerable of records to insert where T has Id field.

IEnumerable<T> records

this snippet will do a bulk upsert (the filter condition may be changed according to the situation):

var bulkOps = new List<WriteModel<T>>();
foreach (var record in records)
{
    var upsertOne = new ReplaceOneModel<T>(
        Builders<T>.Filter.Where(x => x.Id == record.Id),
        record)
    { IsUpsert = true };
    bulkOps.Add(upsertOne);
}
collection.BulkWrite(bulkOps);

edited Mar 21 '18 at 14:04

answered Mar 21 '18 at 13:52

Aviko

1,139
12
21

1

I like this approach but is it true that each "record" in "records" must contain an _Id value? The source of my records does not include the _Id field. So I need to locate single records using an alternate unique key, e.g. ukey. When I used x.ukey == record.ukey the update failed because the record._Id field is all zeros. Is there a good way to do this in one upsert or do I have to fetch the target records so I can set the _Id column before doing the upsert? – BigTFromAZ May 04 '18 at 20:54
I hesitated to use after i saw Replace. So used UpdateOneModel it was too slow. Just came again and checked it booom ! It's so fast. – vinoth kumar Jun 15 '20 at 17:01

score 1 · Answer 3 · answered Jan 07 '20 at 16:47

Here is an extension method based on @Aviko response

public static BulkWriteResult<T> BulkUpsert<T>(this IMongoCollection<T> collection, IEnumerable<T> records)
    {
        string keyname = "_id";

        #region Get Primary Key Name 
        PropertyInfo[] props = typeof(T).GetProperties();

        foreach (PropertyInfo prop in props)
        {
            object[] attrs = prop.GetCustomAttributes(true);
            foreach (object attr in attrs)
            {
                BsonIdAttribute authAttr = attr as BsonIdAttribute;
                if (authAttr != null)
                {
                    keyname = prop.Name;
                }
            }
        }
        #endregion

        var bulkOps = new List<WriteModel<T>>();


        foreach (var entry in records)
        {
            var filter = Builders<T>.Filter.Eq(keyname, entry.GetType().GetProperty(keyname).GetValue(entry, null));

            var upsertOne = new ReplaceOneModel<T>(filter, entry){ IsUpsert = true };

            bulkOps.Add(upsertOne);
        }

        return collection.BulkWrite(bulkOps);

    }

C# mongodb driver 2.0 - How to upsert in a bulk operation?

3 Answers3

Linked