How to insert bulk data in database using hibernate and spring DAO pattern

Question

I am working on an application which is using Spring DAO + hibernate structure to deal with database.

I want to insert bulk of rows (20000 approx) in oracle database using hibernate, but using .save() is very slow.

I learned that using StateLess session this can be done, but because all sessions are managed through BaseDaoImp class, i don't know how to create stateless sessions in this design pattern.

Please help if anybody knows how to implement this.

Use Hibernate native query by managing transaction. – Manish Prajapati Sep 12 '16 at 07:21 — Manish Prajapati, Sep 12 '16 at 07:21
Please elaborate a bit how to do this – shrish Sep 12 '16 at 07:22 — shrish, Sep 12 '16 at 07:22

score 0 · Accepted Answer · edited May 23 '17 at 12:22

0

Add entityManager.flush() and entityManager.clear() after every n-th call to the save() method. If you use hibernate then add hibernate.jdbc.batch_size and set it to equal n. 100 might be enough but it is your choice.

see: Massive insert with JPA + Hibernate or http://frightanic.com/software-development/jpa-batch-inserts/

Answers are quite old but seems work fine.

edited May 23 '17 at 12:22

Community

1
1

answered Sep 12 '16 at 07:25

tomaszwasik

119
9

Session object are managed internally through BaseDaoI.java (DAO object), and i cannot make changes to it. all i have is methods, .persist .save etc etc to work – shrish Sep 12 '16 at 07:33

score 0 · Answer 2 · answered Sep 12 '16 at 07:40

Try this code snippet, it was was similar to approach we using in JDBC batching..

public Long save(HttpServletRequest request) {

**//Further business logic here....**
for ( int i=0; i<count; i++ ) {
                     getEntityManager().persist((ABC) model);

            if ( i > 0 && i % 2500== 0 ) {
                               getEntityManager().flush();
                               getEntityManager().clear();
                          }
                  }
                     tx.commit();
                   ((EntityManager) session).close();
    }

How to insert bulk data in database using hibernate and spring DAO pattern

2 Answers2