0

I'm new to Hadoop and I wonderer: is there a way to check does .parquet file contains any value or not without executing spark query?

Majid Hajibaba
  • 3,105
  • 6
  • 23
  • 55
Taras
  • 409
  • 4
  • 18
  • 1
    Parquet is independent of Spark, so you can view it without needing Spark. https://stackoverflow.com/questions/28615511/how-to-read-a-parquet-file-in-a-standalone-java-code for example. – Ben Watson Jul 26 '21 at 14:53
  • In particular, you may find `parquet-tools` quite useful to view metadata and dump content of parquet files. https://github.com/apache/parquet-mr/tree/parquet-1.11.x/parquet-tools – mazaneicha Jul 27 '21 at 18:48

0 Answers0