1

Is there a command avaialble to copy the files from HDFS to another linux box.

The Cluster is secured one.

I hope the copyToLocal will copy the files inside the cluster, actually i wanted to copy files outside the cluster.

Shankar
  • 8,529
  • 26
  • 90
  • 159
  • This post shows how to use scp to transfer from HDFS, http://stackoverflow.com/questions/12173715/transfer-file-out-from-hdfs – ocurran Nov 02 '15 at 12:04

1 Answers1

0

You could use WebHDFS to copy the file to your local machine. See for example here: http://hortonworks.com/blog/webhdfs-%E2%80%93-http-rest-access-to-hdfs/.

Since your cluster is secured (I suppose using Kerberos), you will need to get a Kerberos ticket (with kinit), and add flags like: -udummy:dummy --negotiate to your curl command.

Hellmar Becker
  • 2,824
  • 12
  • 18