Sqoop import failiing

Question

I am trying to run parallel sqoop Jobs in hadoop cluster however we see that during parallel runs the sqoop Jobs are failing with the following error.

16/11/11 09:24:59 ERROR manager.SqlManager: Error executing statement: java.sql.SQLRecoverableException: IO Error: Connection reset
java.sql.SQLRecoverableException: IO Error: Connection reset
    at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:682)
    at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:715)
    at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:385)
    at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:30)
    at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:564)
    at java.sql.DriverManager.getConnection(DriverManager.java:664)
    at java.sql.DriverManager.getConnection(DriverManager.java:247)
    at org.apache.sqoop.manager.OracleManager.makeConnection(OracleManager.java:327)
    at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
    at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:744)
    at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:767)
    at org.apache.sqoop.manage

The error seems to happening only when multiple jobs run in hadoop. I was searching the similar error and have come across these links. but the point is how can we accommodate that in sqoop Jobs.

Oracle JDBC intermittent Connection Issue.

Any help on this is really appreciated.

score 0 · Accepted Answer · edited May 23 '17 at 11:55

0

This issue is resolved after adding the property -Dmapred.child.java.opts="-Djava.security.egd=file:///dev/urandom".

Details of the issue is provided by Oracle JDBC intermittent Connection Issue

and

Oracle 11g connection reset error

Kudos to the answers provided by the guys in the link.

edited May 23 '17 at 11:55

Community

1
1

answered Nov 18 '16 at 14:07

Rakesh Shrama

249
1
5
16

Sqoop import failiing

1 Answers1