hadoop while running my program following message displayed. what does it mean?

Asked Dec 15 '14 at 11:27

Active Apr 10 '22 at 02:20

Viewed 4,870 times

I was running hadoop program and I got following message. what does it mean? should I need to worry about this message?

INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.io.EOFException: Premature EOF: no length prefix available

at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:531)
14/12/15 16:39:36 WARN hdfs.DFSClient: Error Recovery for block BP-1435953827-192.168.33.125-1417678953955:blk_1073749097_67711 in pipeline 192.168.33.199:50010, 192.168.33.125:50010, 192.168.33.123:50010: bad datanode 192.168.33.199:50010

edited Dec 15 '14 at 11:29

Ahmad

12,336
6
48
88

asked Dec 15 '14 at 11:27

Divyang Shah

1,578
1
11
22

Ahmad, do you know reason? – Divyang Shah Dec 15 '14 at 12:53
1

Does this help (it looks similar problem) : http://stackoverflow.com/questions/21718900/exception-in-createblockoutputstream-when-copying-data-into-hdfs – PKumar Dec 15 '14 at 15:05
no, Kabir that's different problem. – Divyang Shah Dec 16 '14 at 07:17
actually, I don't got any problem. As mentioned error has been recovered by other node. – Divyang Shah Dec 16 '14 at 07:18
1

I think one of your data node is running bad state or on low disk space. – scalauser Dec 16 '14 at 17:30
This shows that one of the data node is not available. – Rengasamy Dec 17 '14 at 07:11
I think one of the datanode failed during data copy on hdfs. so, data is recovered from other node. – Divyang Shah Dec 17 '14 at 08:41

hadoop while running my program following message displayed. what does it mean?

0 Answers0

Linked