WriteConflict error in MongoDB when running batches of insertMany operation with transaction from Quarkus

Question

Below is a snippet of my transaction implementation. Currently MongoDB will throw WriteConflict error every time when it is processing the records from 800k onwards.

    ClientSession clientSession = mongoClient.startSession();
    clientSession.startTransaction();
    int batchSize = 100000;

    try {
        for (int i = 1; i <= 1000000; i++) {

            ArrayList<SampleData> sampleDataList = new ArrayList();
            sampleDataList.add(new SampleData(i));
            if (i % batchSize == 0 || i == sampleDataList.size()) {
                sampleDataRepo.mongoCollection().insertMany(clientSession, sampleDataList);
                sampleDataList.clear();

            }
        }
        clientSession.commitTransaction();
    }

    catch (Exception e){
        clientSession.abortTransaction();
        throw new Exception(e.getMessage());
    }

Do you have another process that write in the collection ? – JEY Feb 23 '23 at 08:34 — JEY, Feb 23 '23 at 08:34
No, I'm only running this function – Zhen Wei Feb 23 '23 at 08:49 — Zhen Wei, Feb 23 '23 at 08:49

score 0 · Answer 1 · answered Mar 01 '23 at 02:56

0

Resolved by increasing the wiredTigerCacheSizeGB

answered Mar 01 '23 at 02:56

Zhen Wei

339
1
3
3

WriteConflict error in MongoDB when running batches of insertMany operation with transaction from Quarkus

1 Answers1