IOException in my code java

Question

I use spark using java, whenever I try to run my code it appears an IOException in this lines of code :

     SparkConf conf = new SparkConf().setAppName("myapp").setMaster("local[*]");
     JavaSparkContext sc = new JavaSparkContext(conf);

the detail of this exception is :

Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

and when i tried to download winutils.exe and installed it i got this message :

the program cant start bcz MSVCR100.dll is misssing

so how can i solve it please?

Related questions: http://stackoverflow.com/questions/34697744/spark-1-6-failed-to-locate-the-winutils-binary-in-the-hadoop-binary-path and http://stackoverflow.com/questions/14557245/wamp-shows-error-msvcr100-dll-is-missing-when-install — Binary Nerd, Jun 08 '16 at 10:56

score 1 · Accepted Answer · edited Jun 20 '20 at 09:12

1

You need to set HADOOP_HOME variable to some path. Place winutils.exe inside %HADOOP_HOME%\bin.

For the MSVCR100.dll, download it and install.

Make sure, that you download 32 bit/64 bit winutils.exe and dll as per your machine configuration.

Hope it helps you..

edited Jun 20 '20 at 09:12

Community

answered Jun 08 '16 at 10:41

Nishu Tayal

i set the variable and i installed .dll file , honestly i dont know how to do this correctly, would u give me a link bcz i followed what i found in youtube but it didnt work – hammadspark Jun 09 '16 at 14:54

score 0 · Answer 2 · answered Jun 10 '16 at 00:08

finally i fixed this issue , i just followed the way explained in this link , it s easy and clear and efficient link: http://teknosrc.com/spark-error-java-io-ioexception-could-not-locate-executable-null-bin-winutils-exe-hadoop-binaries/ wanna thank you #Nishu Tayal

2 Answers2