Stack Overflow
Stack Overflow

Questions tagged [sqoop2]

SQOOP2 is the 2nd generation version of SQOOP. DO NOT USE this tag for SQOOP questions. Use the sqoop tag instead. SQOOP2 was designed to fix the tight coupling that SQOOP has with Hadoop. But as of Nov 2017 is no longer actively maintained.

From Upgrading Sqoop 2 from an Earlier CDH 5 Release

Note: Sqoop 2 is being deprecated. Cloudera recommends using Sqoop 1.

References

176 questions
13
votes
2 answers

Sqoop2: Build fails: Missing org/sonatype/aether/graph/DependencyFilter

When building Sqoop2 with: mvn package -Pbinary I get an error: "A required class was missing while executing org.apache.maven.plugins:maven-site-plugin:3.0-beta-3:site: org/sonatype/aether/graph/DependencyFilter" How to build Sqoop2? I am…
dokondr
  • 3,389
  • 12
  • 38
  • 62
7
votes
5 answers

What is --direct mode in sqoop?

As per my understanding sqoop is used to import or export table/data from the Database to HDFS or Hive or HBASE. And we can directly import a single table or list of tables. Internally mapreduce program (i think only map task) will run. My doubt is…
Raj
  • 537
  • 4
  • 9
  • 18
7
votes
1 answer

Sqoop - Binding to YARN queues

So with mapreduce v2 you can use binding to certain YARN queues to manage resources and prioritization. Basically by using "hadoop jar /xyz.jar -D mapreduce.job.queuename=QUEUE1 /input /output" which works perfectly. How can integrate Yarn queue…
user2562618
  • 327
  • 6
  • 14
5
votes
3 answers

How to change sqoop metastore?

I am using sqoop 1.4.2 version. I am trying to change the sqoop metastore from default hsqldb to mysql. I have configured following properties in sqoop-site.xml file. sqoop.metastore.client.enable.autoconnect …
Chetan Shirke
  • 896
  • 4
  • 13
  • 35
4
votes
2 answers

Sqoop Import to Hive hangs indefinitely at a point

I'm trying to import mysql table to Hive using Sqoop Import, however after the command execution, the CLI stays calm nothing happens and it hangs indefinitely. Below is the command and issue details.. [cloudera@quickstart bin]$ sqoop…
Ramakrishna
  • 53
  • 1
  • 8
3
votes
0 answers

How to make Sqoop to work with two different versions of oracle jdbc driver

I am to use Sqoop to work with two versions of oracle. For each version of the oracle, we need a specific version of oracle jdbc driver jar to talk with oracle. I put the two oracle jdbc jars into $SQOOP_HOME/lib, which will lead to classpath…
Tom
  • 5,848
  • 12
  • 44
  • 104
3
votes
0 answers

sqoop2 rest api is not working : NullPointerException

I am using sqoop 1.99.7, hadoop 2.7.2 firstly, when I requested to "/sqoop/v1/link" with json("http://sqoop.apache.org/docs/1.99.7/dev/RESTAPI.html#v1-link-post-create-link"), I met "links" key missing error. so I tried to get link informaion. and I…
rura6502
  • 365
  • 2
  • 15
3
votes
0 answers

how to import tables into hive with columns having new line characters with sqoop?

I am trying to hive-import a mysql table using sqoop which has a column that stores json data containing new line chars. For handling hive default delimiters, I tried to change the line delimiter using sqoop's --lines-terminated-by '\u002' option.…
learner
  • 31
  • 4
3
votes
1 answer

Sqoop vs Sqoop2 commands

One of the advantages of migrating to Sqoop2 is that we are not sharing database credentials with clients. Now when we execute Sqoop commands, they look like below: sqoop import --connect ... --username ... --table ... When we upgrade to Sqoop2…
Bhavuk Chawla
  • 212
  • 1
  • 10
3
votes
1 answer

sqoop server start failed

I am trying to connect to a sqoop server on localhost: sqoop:000> set server --host manager --port 12000 --webapp sqoop Server is set successfully sqoop:000> show version -all client version: Sqoop 1.99.6 source revision…
user5187754
  • 31
  • 2
3
votes
3 answers

Unable to create JOB in SQOOP

I ran below snippet in SQOOP and ended up with error listed below the code. bin/sqoop job --create myjob import --connect jdbc:mysql://localhost/test -username root -password root --table patient -m 1 --target-dir…
Bala
  • 81
  • 1
  • 3
  • 7
3
votes
5 answers

SQOOP Not able to import table

I am running below command on sqoop sqoop import --connect jdbc:mysql://localhost/hadoopguide --table widgets my version of sqoop : Sqoop 1.4.4.2.0.6.1-101 Hadoop -- Hadoop 2.2.0.2.0.6.0-101 Both taken from hortonworks distribution. all the paths…
user236575
  • 95
  • 1
  • 3
2
votes
0 answers

Sqoop export stored procedure for postgres

I am trying to execute a stored procedure using sqoop. Idea is to perform upsert to my postgres table from an HDFS file: HDFS FILE URL ,LAST_UPDATED, LAST_SEEN, …
Neethu Lalitha
  • 3,031
  • 4
  • 35
  • 60
2
votes
0 answers

Sqoop mysql error - communications link failure

Trying to run the below Command: sqoop import --connect jdbc:mysql://---.--.--.--:3306/home_credit_risk --table bureau --target-dir /home/sqoop --username root -password root; I have Placed the mysql connector in the sqoop/lib folder and given…
Rahul Goyal
  • 433
  • 2
  • 8
2
votes
1 answer

Is there a way to execute free form query from a file in sqoop?

Have executed a similar kind of sqoop command as shown below. The free form query mentioned below, I wanted to keep it in a file and run the sqoop command since my real time queries are quite complex and bigger. Wanted to know, Is there a way to…
CodingOwl
  • 156
  • 1
  • 11
1
2 3
…
11 12