How can I do massive insert using Hibernate?

Question

I am pretty new to Spring Data JPA and Hibernate and I have the following problem with massive record insertion.

I have the following situation:

1) A RoomMediaDAO Spring Data JPA interface:

@Repository
@Transactional(propagation = Propagation.MANDATORY)
public interface RoomMediaDAO extends JpaRepository<RoomMedia, Long> {

   ....................................................................
   ....................................................................
   ....................................................................
}

2) Into another class I use this RoomMediaDAO to persist a list of RoomMedia object. The list is pretty big and heavy because contains many object and each oof these objects contains a byte[] field representing a BLOB on the mapped table.

So I have the follosing statment that persist the List mediaListToBeInserted:

roomMediaDAO.save(mediaListToBeInserted);

It work fine but it is very slow because it perform the insert one by one, infact in the console I can see something like this:

Hibernate: insert into room_media (description, media, id_room, time_stamp) values (?, ?, ?, ?)
Hibernate: insert into room_media (description, media, id_room, time_stamp) values (?, ?, ?, ?)
Hibernate: insert into room_media (description, media, id_room, time_stamp) values (?, ?, ?, ?)
Hibernate: insert into room_media (description, media, id_room, time_stamp) values (?, ?, ?, ?)
Hibernate: insert into room_media (description, media, id_room, time_stamp) values (?, ?, ?, ?)
............................................................................
............................................................................
............................................................................

So this is not a good solution.

How can I say to Hibernate to insert more record with a single insert statment? I mean can I do something like this using Hibernate?

INSERT INTO MyTable ( Column1, Column2 ) VALUES
( Value1, Value2 ), 
( Value1, Value2 ),
( Value1, Value2 ),
.................................
.................................
.................................
( Value1, Value2 )

I absolutly need something like this to improve the performance of my batch.

Look - http://stackoverflow.com/questions/12011343/how-do-you-enable-batch-inserts-in-hibernate — Gurwinder Singh, Jan 01 '17 at 17:45

Kishore Bandi · Accepted Answer · 2017-01-01T21:33:48.077

This link provides a detailed explanation about different ways of performing batch inserts. Mentioned in Italics are some problems with these approaches.

Using batch_size (13.1 section in the link provided) - In case you've alternating inserts (non-sequential inserts into a table, Table1 followed by Table2 and again Table1 and soon) then remember to use order_inserts.
Also, doesn't work if Generator is of type Identity.
Using StatelessSession for insertion. (13.3) - Inserted values are not stored in First Level Cache.
May result in data aliasing effects (due to missing FLC), Also bypasses Hibernate's event model and interceptors.
Using DML-style operations
(Insert with Select is Only supported, not values)
If you're using Postgres (Or for other DB, check if those DB's support any Bulk insert Operation, then leveraging on that is a very good option). Making use of Copy manager features to upload all this data in one shot. Comparison of Performance.
Make Sure the PushbackReader used is not overflown. I misjudged this and had to face some prod. issues with BufferOverflow.

PS : Each of the approaches have their adv & dis-adv. Choose the one that suits you.

How can I do massive insert using Hibernate?

1 Answers1

Linked