hadoop.dll file location for Spark 3.3.1 on Windows

Asked Nov 11 '22 at 06:21

Active Dec 01 '22 at 07:46

Viewed 80 times

I want to run Spark 3.3.1 on Windows 10. That's why I had to download winutils.exe and hadoop.dll for Hadoop 3.3. I must save hadoop.dll in C:\Windows\System32 to avoid this Spark error:

java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z

I want to know if there's a way to change the hadoop.dll path, so I won't need admin rights to save a file in System32 directory.

asked Nov 11 '22 at 06:21

Diego Dávila Vilchez

have you tried setting environment variable `HADOOP_HOME`? – mazaneicha Nov 11 '22 at 22:15
@mazaneicha I don't think setting that will do anything about native files, especially dll files – OneCricketeer Nov 12 '22 at 14:23
Another thing to try -- add `\bin` to PATH env var. – mazaneicha Nov 12 '22 at 15:56

hadoop.dll file location for Spark 3.3.1 on Windows

0 Answers0