3

I have to ingest a CSV file in HDFS using Sqoop.

The problem is that I am using a ',' (comma) as a separator, and my data also has a column with ','s. which is creating a problem parsing the data.

Can anyone suggest what should I do to solve the issue?

Can I use SQOOP or not?

Jonah
  • 1,013
  • 15
  • 25
Rani
  • 119
  • 1
  • 2
  • 9

1 Answers1

0

You can use the sqoop specific argument --fields-terminated-by to seperate the fields when importing the data to hdfs using sqoop.

If you are trying to import the csv file from local file system then in that case you can directly use hadoop fs -put command to put he files into hdfs.

Vamshi Krishna
  • 76
  • 1
  • 9