1

The error statement:

org.apache.spark.logging couldn't be resolved. It is indirectly referenced from required .class files

I read about the error here (general to such errors). Further I found that org.apache.spark.logging is in fact not available for Spark versions > 1.5.2 here.

I am able to run the code by setting the spark version to 1.5.2. Is there any way to run the same code (with some changes, if required) using Spark version 2.1.1 ? I am specifically trying this code.

I am new to maven, eclipse and spark, therefore a detailed answer explaining the stuff would be highly appreciated.

firewithin
  • 559
  • 1
  • 5
  • 12

1 Answers1

0

It seems you are using the Spark 2.1.1 so please use the below depedency to resolve the issue.

   <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-streaming-kafka-0-8_2.11</artifactId>
        <version>2.1.1</version>            
    </dependency>
ven2k12
  • 9
  • 1
  • Hi, I added this dependency to the POM file, also set the spark version to 2.1.1. Have a at the ([pom](https://pastebin.com/xirXYgvN)) file. The problem persists. – firewithin Jul 03 '17 at 04:53