Questions tagged [spark-repl]

I've recently started using SparkR and would like to do logging with it while running sql queries, performing joins, moving data into csv etc. I'm able to run sql queries and fecthing data from oracle and hive tables into SparkR dataframe but it…

I have define some trait and class in spark program, it works well when packaged into a jar, but if execute in spark repl, it will fail. trait Builder { trait Layer { def layerSize: Int } abstract class Layer1 extends Layer class…

I have build spark v 2.3.2 on big endian platform using adopt jdk 1.8 build is successful and we encounter test case failures in the following module. I wanted some information related to this failing test, information on how severely would this…

I'm haveing trouble, I presume with serialization, in a Spark repl. I have the following code snippet: class Foobar (val a: Int, val b: Int) extends Serializable { override def equals (other: Any): Boolean = other match { case that:…