3

I am trying to test my driver with MRUnit and my MapDriver format is MapDriver <LongWritable, Group, ImmutableBytesWritable, KeyValue> I have found the correct serialization for KeyValue but cannot find one for Group and I get the following error.

    Group group = sfg.newGroup()
    parquetMapDriver.withInput(new LongWritable(), group);

No applicable class implementing Serialization in conf at io.serializations: class org.apache.parquet.example.data.simple.SimpleGroup

I am currently setting io.serializations like so

    parquetMapDriver = MapDriver.newMapDriver(parquetMapper);
    conf = parquetMapDriver.getConfiguration();
    conf.setStrings("io.serializations", conf.get("io.serializations"),
    MutationSerialization.class.getName(),
    KeyValueSerialization.class.getName(),
    WritableSerialization.class.getName(),
    ResultSerialization.class.getName());

Where I can find the serialization for Hadoop's Group Class?

Nimeshka Srimal
  • 8,012
  • 5
  • 42
  • 57
abtomb
  • 31
  • 2

0 Answers0