Java Spark: com.mongodb.spark.config.writeconfig issue

Question

I am trying to connect with MongoDB via java spark connector and I am getting an error "com.mongodb.spark.config.writeconfig", when I submit the jar and run the jar in spark shell. Here the error screenshot:

Could you please help me to resolve this issue. I have tried this as well, but no success.

$./bin/sparkR --conf "spark.mongodb.input.uri=mongodb://127.0.0.1/test.myCollection?readPreference=primaryPreferred" ./bin/sparkR --conf "spark.mongodb.output.uri=mongodb://127.0.0.1/db.test" ./bin/spark-shell --packages org.mongodb.spark:mongo-spark-connector_2.11:2.2.0
$spark-submit --master local --class com.test.spark.SparkClient /home/otalogin/SparkClient.jar
$spark-submit --master local --class com.test.spark.SparkClient /home/otalogin/SparkClient.jar --jar mongo-spark-connector_2.11:2.2.0

but getting same error.

Please help me out of this issue.

No, we just export the JAR from eclipse and submit on a terminal. — Vinay Mishra, Dec 27 '17 at 06:30
Can you just add an answer how you fixed it i need help as i have the same issue now — Sundeep Pidugu, Nov 26 '18 at 06:41
Hi Sundeep, I fix this issue, to fresh setup and download all maven dependencies, then build and check the jar size. it should include all dependent configuration file. — Vinay Mishra, Nov 26 '18 at 12:43

score 0 · Accepted Answer · answered Dec 28 '17 at 10:47

0

As suggested by Darshan M, you need to provide mongo dependencies.

The easiest way is to build a fat jar using maven / sbt.

If you use maven, configure your pom.xml, this can help you. If you use sbt, that can help you.

answered Dec 28 '17 at 10:47

Bameza

207
2
16

Thanks Bameza and Darshan M, for help. Now everything is working fine as expected. – Vinay Mishra Dec 29 '17 at 06:29
please help me in fixing the same – Sundeep Pidugu Nov 26 '18 at 08:28

Java Spark: com.mongodb.spark.config.writeconfig issue

1 Answers1