0

I have a problem with Hadoop. I am on mac OS and I have a problem when I want to launch my node. I installed Hadoop this way :

brew install hadoop

I also configured the different files like this :

hadoop-env.sh :

export HADOOP_OPTS="$HADOOP_OPTS -Djava.net.preferIPv4Stack=true -Djava.security.krb5.realm= -Djava.security.krb5.kdc="
export JAVA_HOME="/Library/Java/JavaVirtualMachines/jdk-17.0.2.jdk/Contents/Home"

core-site.xml :

<!-- Put site-specific property overrides in this file. --><configuration>
  <property>
    <name>hadoop.tmp.dir</name>
    <value>/usr/local/Cellar/hadoop/hdfs/tmp</value>
    <description>A base for other temporary directories</description>             
  </property>
  <property>
    <name>fs.default.name</name>
    <value>hdfs://localhost:8020</value>
  </property>
</configuration>

mapred-site.xml :

<configuration>
  <property>
    <name>mapreduce.framework.name</name>
    <value>localhost:8021</value>
  </property>
</configuration>

hdfs-site.xml :

<configuration>
  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>
</configuration>

I finally executed this command:

hdfs namenode -format

Finally when I want to launch the command ./start-dfs.sh I get this error :

"ERROR: Cannot set priority of secondarynamenode process 31231"

I would like to specify that my main node launches correctly :

enter image description here

I can't find a solution on the internet. Has anyone faced the same situation as me?

I tried all the solutions but doesn't work : localhost: ERROR: Cannot set priority of datanode process 32156

Sincerely,

OneCricketeer
  • 179,855
  • 19
  • 132
  • 245
Junot
  • 137
  • 6
  • 1
    Look at the log file created, not terminal output. Try downgrading to Java 11. Also, `mapreduce.framework.name` needs to be `yarn`. Seems like you copied something wrong – OneCricketeer Nov 20 '22 at 13:14
  • @OneCricketeer I don't find the log file... but I downgrade to Java 11 et change to yarn but nothing change. I had the same error... – Junot Nov 20 '22 at 14:28

1 Answers1

0

For people who had the same problems as me, here is a tuto that might work: :https://techblost.com/how-to-install-hadoop-on-mac-with-homebrew/

Junot
  • 137
  • 6