Hadoop is an Apache open-source project that provides software for reliable and scalable distributed computing.
Hadoop is an Apache open-source project that provides software for reliable and scalable distributed computing.
Questions tagged [hadoop2.7.3]
11 questions
5
votes
1 answer
Hadoop 2.7.3 Java Runtime error - core-site.xml not found
When running the hdfs dfs -mkdir /abc I get the following error.
Exception in thread "main" java.lang.RuntimeException: core-site.xml not found
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2577)
at…
shubhamgoel27
- 1,391
- 10
- 17
2
votes
1 answer
Some datanodes still showing block pool used after clearing the HDFS
Hadoop Version: 2.7.3
Datanodes: 32
BlockSize: 512m
Replication: 3
I Cleared all the data in HDFS using the command
hdfs dfs -rm -r /*
After clearing the HDFS cluster, few datanodes still showing the Block pool used, though blocks are zero.
The…
Bidyut
- 933
- 1
- 14
- 30
1
vote
1 answer
Sqoop error while executing Simple SQOOP import comand on Hadoop 2.7.3
I am running Sqoop 1.4 with Hadoop-2.7.3. And also using MySQL 5.7 as metastore of Hive-2.1.1. When running any Sqoop eval command or HDFS operation it is working fine. But when importing data from MySQL to HDFS it is generating following errors. At…
HimanshuSPaul
- 278
- 1
- 4
- 19
1
vote
0 answers
Spark app doesn't write to s3 bucket
The problem is:
I have spark application , which can't write data to s3.
Reading is fine.
Spark configuration:
SparkConf conf = new SparkConf();
...
conf.set("spark.hadoop.fs.s3a.endpoint",…
yazabara
- 1,253
- 4
- 21
- 39
1
vote
1 answer
Error in datanode Hadoop 2.7.3 single node (pseudo-distributed mode)
I am quite new to hadoop, and I've already respond to my previous question for this ,but the comment section is too short for me to show my log files.
This is my previous question . Can anyone help me to find the error in this log file? I would…
Hippie-pina
- 81
- 2
- 12
1
vote
2 answers
Hadoop exception.
I am trying to run the wordcount problem of hadoop, as it is for the first time I am working with it. I have followed the instructions using videos and even read many things before running the program.
But still I encountered an exception while…
Jaffer Wilson
- 7,029
- 10
- 62
- 139
0
votes
0 answers
How to configure the Yarn cluster with spark?
I have 2 machines with 32gb ram and 8core each machine. So how can i configure the yarn with spark and which properties i have to use to tune the resources according to our dataset. I have 8gb dataset, So can anyone suggest the configuration of yarn…
vikram reddy
- 1
- 2
0
votes
1 answer
apache spark2.3.0 when launched with master as yarn, fails with error Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster
I have installed Apache Hadoop 2.7.5 and Apache Spark 2.3.0.
When I am submitting my job with --master local[*] it runs fine. But when I run --master yarn the error from the web logs says
Error: Could not find or load main class…
aiman
- 1,049
- 19
- 57
0
votes
2 answers
Unable to Start Namenode, Secondary Namenode & Datanode
I have installed Hadoop-2.7.3 on VirtualBox.
When I type the command ./start-all.sh in the terminal, the Namenode, Secondary Namenode & Datanode were not starting. The below is the error screenshot. Please suggest some solution for this issue.
Error…
Sreenu Aluru
- 1
- 2
0
votes
1 answer
Hadoop 2.7.3 not running in offline mode
I am running hadoop 2.7.3 single node on ubuntu 16.04... But its not
working in offline mode.. Can the problem be in /etc/hosts file as I
tried to edit it, to make it a multi node cluster...
poshita singh
- 131
- 1
- 1
- 9
0
votes
0 answers
Common crawl example having doubts
I am trying to run a common crawl example and extracting URL and emails from the Warc file. I have just one doubt. Whether the email I have extracted belongs to the URL or some other website, this is a confusing part.
Kindly, help me. How can I…
Jaffer Wilson
- 7,029
- 10
- 62
- 139