Hadoop\HDFS: "no such file or directory"

Question

I have installed Hadoop 2.2 on a single machine using this tutorial: http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

Some details were changed a little bit - for example, I used java 8, /hadoop root dir etc. Users, SSH, config keys - the same.

Namenode was successfully formatted:

13/12/22 05:42:31 INFO common.Storage: Storage directory /hadoop/tmp/dfs/name has been successfully formatted.
13/12/22 05:42:31 INFO namenode.FSImage: Saving image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
13/12/22 05:42:32 INFO namenode.FSImage: Image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 198 bytes saved in 0 seconds.
13/12/22 05:42:32 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
13/12/22 05:42:32 INFO util.ExitUtil: Exiting with status 0
13/12/22 05:42:32 INFO namenode.NameNode: SHUTDOWN_MSG:

However, not 'mkdir' neither even 'ls' command worked:

$ /hadoop/hadoop/bin/hadoop fs -ls
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /hadoop/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
13/12/22 05:39:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `.': No such file or directory

Thanks for any help guys.

update: **/hadoop/hadoop/bin/hadoop fsck -move** prints _The filesystem under path '/' is HEALTHY_ — Spaceman, Dec 22 '13 at 15:14
`ls: '.': No such file or directory` could mean you have nothing (no file nor folder) in hdfs. You mentioned `hadoop fs -mkdir` doesn't work as well, what's the error? have you tried `hadoop fs -mkdir /tmp`? — zhutoulala, Dec 24 '13 at 05:26
@zhutoulala too late =) I switched to Disco MR framework and I'm quite happy with it... Hadoop feels like one of the most user-unfriendly tools I've ever used. "Java style", yeah. — Spaceman, Dec 25 '13 at 12:51
You may take a look at more user-friendly Hadoop distros such as Cloudera or hortonworks, which have everything integrated into a web portal... — zhutoulala, Dec 26 '13 at 06:45
@zhutoulala well, I see no real reasons to migrate - it's just a tool, and I use the one which works fine for me. But thanks for Hortonworks, their website is much better than Cloudera's one, will try their distro some day. — Spaceman, Dec 27 '13 at 14:35
**DUPLICATE** http://stackoverflow.com/questions/20821584/hadoop-2-2-installation-no-such-file-or-directory — Carlos Rodriguez, Jul 11 '14 at 15:38

score 11 · Answer 1 · edited Jun 21 '14 at 00:13

11

Try

hadoop fs -ls /

Tested on hadoop 2.4

edited Jun 21 '14 at 00:13

Prashant Kumar

20,069
14
47
63

answered Jun 20 '14 at 23:28

user3761855

171
2
3

score 11 · Answer 2 · answered Jun 29 '14 at 05:11

11

In Hadoop 2.4

hdfs dfs -mkdir /input
hdfs dfs -ls /

answered Jun 29 '14 at 05:11

user602599

661
11
22

score 2 · Answer 3 · edited Apr 18 '17 at 05:24

2

I have verified this worked in Hadoop 2.5

hdfs dfs -mkdir /input

(where /input is the HDFS directory)

edited Apr 18 '17 at 05:24

Ani Menon

27,209
16
105
126

answered Aug 25 '14 at 14:13

Haans

73
1
1
7

score 2 · Answer 4 · answered Sep 24 '14 at 12:49

Worked in my case: First Get hadoop installed path by :

echo ${HADOOP_INSTALL} //in my case output is : `/user/local/hadoop`

Then create directory at your hadoop installed path, If you know your hadoop installed directory ignore above command

hadoop fs -mkdir -p /user/local/hadoop/your_directory

Here hadoop is directory

Tested on hadoop 2.4

Hadoop\HDFS: "no such file or directory"

4 Answers4