0

I am using this code to define an encoder for spark 2.x, in scala 2.1.1:

import org.apache.spark.sql.Encoder
import org.apache.spark.sql.types.StructType

class LogProcessorMessageEncoder extends Encoder[LogProcessorMessage] {
    override def schema: StructType = null

    override def clsTag: Class[LogProcessorMessage] = classOf[LogProcessorMessage]
}

object LogProcessorMessage {}

class LogProcessorMessage extends Serializable {}

And IntelliJ says it is fine, but the override of the clsTag method results in a compiler error:

Error:(20, 15) overriding method clsTag in trait Encoder of type => scala.reflect.ClassTag[dvn.aast.telemetry.scala.stream.LogProcessorMessage];
method clsTag has incompatible type
override def clsTag: Class[LogProcessorMessage] = classOf[LogProcessorMessage]
absmiths
  • 1,144
  • 1
  • 12
  • 21

1 Answers1

1

clsTag has to be ClassTag not Class:

class LogProcessorMessageEncoder extends Encoder[LogProcessorMessage] {
  override def clsTag: ClassTag[LogProcessorMessage] = ClassTag(classOf[LogProcessorMessage])
  override def schema: StructType = null 
}
user8820838
  • 61
  • 1
  • You can write this as just `classTag[LogProcessorMessage]` (just import `classTag` along with `ClassTag`). – Alexey Romanov Oct 23 '17 at 18:30
  • Thank you both very much! The original def was generated by IntelliJ - I should have looked at the return type more closely. Thanks a bunch. – absmiths Oct 23 '17 at 22:20