22

I have some Apache Parquet file. I know I can execute parquet file.parquet in my shell and view it in terminal. But I would like some GUI tool to view Parquet files in more user-friendly format. Does such kind of program exist?

Roman Zavodskikh
  • 513
  • 1
  • 6
  • 14
  • 1
    Please see my answer [here](https://stackoverflow.com/a/74079053/1719931) on how to use DBeaver to view parquet files. – robertspierre Mar 07 '23 at 11:22

7 Answers7

16

There is Tad utility, which is cross-platform. Allows you to open Parquet files and also pivot them and export to CSV. Uses DuckDB as it's backend. More info on the DuckDB page:

GH here: https://github.com/antonycourtney/tad

enter image description here

Gabe
  • 5,113
  • 11
  • 55
  • 88
14

GUI option for Windows, Linux, MAC

You can now use DBeaver to

  • view parquet data
  • view metadata and statistics
  • run sql query on one or multiple files. (supports glob expressions)
  • generate new parquet files.

DBeaver leverages DuckDB driver to perform operations on parquet file. Features like Projection and predicate pushdown are also supported by DuckDB.

Simply create an in-memory instance of DuckDB using Dbeaver and run the queries like mentioned in this document. Right now Parquet and CSV is supported.

Here is a Youtube video that explains the same - https://youtu.be/j9_YmAKSHoA

enter image description here

ns15
  • 5,604
  • 47
  • 51
8

Check out this utility. Works for all windows versions: https://github.com/mukunku/ParquetViewer

Sal
  • 5,129
  • 5
  • 27
  • 53
  • 1
    Thanks for your suggestion, I've tried it, but for parquet with complex structure, like a JSON, this type of utility doesn't work. It works with parquet with a plain structure, like a CSV. – Francesco Marchitelli Dec 14 '18 at 09:20
  • I tried this one as well. In my parquet file it seems to mess up every 2nd row by inserting an incorrect 0 value in the first column and moving all the correct values down a row for each 0 it inserts. I tried the BigDataFileViewer which can view my files correctly but only if you open the file twice. The first time it throws an error about incorrect magic numbers in the tail, but then seemingly works correctly when you open the file a 2nd time. The schema and table data seem correct. – Roochiedoor Nov 15 '20 at 22:06
  • @Roochiedoor maybe open an issue ticket on the repo with the example file? – Sal Nov 16 '20 at 16:40
  • @Sal logged a ticket at https://github.com/mukunku/ParquetViewer/issues/20 just now – Roochiedoor Nov 17 '20 at 00:43
  • I like it, it's fast and simple, i just want to (pre)view tabular parquet files – citynorman Mar 28 '21 at 15:40
4

Actually I found some Windows 10 specific solution. However, I'm working on Linux Mint 18 so I would like to some Linux (or ideally cross-platform) GUI tool. Is there some other GUI tool?

https://www.channels.elastacloud.com/channels/parquet-net/how-about-viewing-parquet-files

Roman Zavodskikh
  • 513
  • 1
  • 6
  • 14
4

There is a GUI tool to view Parquet and also other binary format data like ORC and AVRO. It's pure Java application so that can be run at Linux, Mac and also Windows. Please check Bigdata File Viewer for details.

It supports complex data type like array, map, struct etc. And you can save the read file in CSV format.

enter image description here

Eugene
  • 10,627
  • 5
  • 49
  • 67
  • 3
    Currently the tool does not work without fiddling with java, since javafx seems to be missing. see https://github.com/Eugene-Mark/bigdata-file-viewer/issues/25 – Arigion Aug 25 '21 at 13:30
2

There is webassembly viewer which works fully offline: https://aloneguid.github.io/parquet-online/

enter image description here

Ivan G.
  • 5,027
  • 2
  • 37
  • 65
1

JetBrains (IntelliJ, PyCharm etc) has a plugin for this, if you have a professional version: https://plugins.jetbrains.com/plugin/12494-big-data-tools

Pickled
  • 465
  • 1
  • 4
  • 10