0

The Parquet.Net specification says I can read and write in RLE_DICTIONARY encoding. I am trying to read the docs of Parquet.Net and the github repo code, but how do I write my DataTable to use this encoding?

The demo I am basing this off of is found here:

Stack Overflow Parquet Size Discrepancy Question

marc_s
  • 732,580
  • 175
  • 1,330
  • 1,459
cdub
  • 24,555
  • 57
  • 174
  • 303

1 Answers1

-1

I'm finding this answer either, I just found an answer like this: if you are using spark just write DataFrame with

df.write
.option("parquet.enable.dictionary",true) //true is RLE_DICTIONARY and false plain (maybe)
.parquet(yourPath)
SummersKing
  • 301
  • 1
  • 11