Spark Java error in standalone application

Question

I was able to create an executable using launch4j and it works fine on my machine. When I send it to someone to run on their windows machine they get the following error:

Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: spark/TemplateEngine
        at java.lang.Class.getDeclaredMethods0(Native Method)
        at java.lang.Class.privateGetDeclaredMethods(Unknown Source)
        at java.lang.Class.privateGetMethodRecursive(Unknown Source)
        at java.lang.Class.getMethod0(Unknown Source)
        at java.lang.Class.getMethod(Unknown Source)
        at sun.launcher.LauncherHelper.validateMainClass(Unknown Source)
        at sun.launcher.LauncherHelper.checkAndLoadMain(Unknown Source)
Caused by: java.lang.ClassNotFoundException: spark.TemplateEngine
        at java.net.URLClassLoader.findClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        ... 7 more

Any thoughts?

Yes - this explains it. Caused by: java.lang.ClassNotFoundException: spark.TemplateEngine — duffymo, Dec 18 '15 at 10:35
This exe runs fine on my machine on which it was developed. I've added all the dependencies in the class path in launch4j — Zohaib Zaidi, Dec 18 '15 at 11:09
On the node it's not running, make sure that classpath was properly set and this jar is available in the classpath — Ravindra babu, Dec 18 '15 at 11:44
Yes thank you.. that was the issue. Just fixed it .. Had to set a relative class path for the jars — Zohaib Zaidi, Dec 18 '15 at 11:51
Look at [this](http://stackoverflow.com/a/574650/6836941). It works for me. — Matías Sebastián Ávalos, Nov 30 '16 at 21:15

khawarizmi · Answer 1 · 2017-10-16T07:21:26.353

This exception may also occur if your maven dependencies do not have <scope> set to compile time (default) and dependency jars are not available at compile time. For instance if maven dependencies have <scope>provided</scope> in your pom.xml compiler will assume that the JRE/environment will provide these dependency jars but when the sources are compiled and these dependencies are not found, this exception will be thrown.

For example - below may lead to this exception if spark-mllib_2.11 dependency is not found during compile time although they are added and there is no error during editing;

<dependency>
   <groupId>org.apache.spark</groupId>
   <artifactId>spark-mllib_2.11</artifactId>
   <version>2.2.0</version>
   <scope>provided</scope>
</dependency>

Solved the same problem in my case with IntelliJ IDEA + SBT. — CyberPlayerOne, Jan 08 '20 at 08:59

score 1 · Answer 2 · answered Apr 13 '17 at 16:50

I had this problem because my version of java that was as default was 9, and somehow Spark didn't recognize it. So I changed to version 8 and it worked. To change in linux :

sudo update-java-alternatives -s java-1.8.0-openjdk-amd64

In your case you may want another version, so choose yours (to list the versions you have in your computer use the -l option).

score 0 · Answer 3 · answered Dec 18 '15 at 11:52

0

Had to set relative paths in the class path so the executable could locate the jar files

answered Dec 18 '15 at 11:52

Zohaib Zaidi

288
4
11

You could also build a fat jar using maven-assembly-plugin. – Aug 24 '16 at 12:37

Spark Java error in standalone application

3 Answers3