Implement `collect_list` via Spark SQL

Question

I am trying to implement the collect_list function is Spark.SQL. The way to do it in PySpark via a dataframe is available here

I am trying to do the same thing via a SQL query.

`spark.sql("select collect_list(col) from test group by col")` — Lamanus, Mar 27 '20 at 10:29

score 1 · Accepted Answer · answered Mar 27 '20 at 10:31

1

It has little to do with pyspark or Spark with Scala.

Try this:

SELECT c1, collect_list(struct(c2, c3)) FROM tempview/table GROUP BY c1

or a variation based on your requirements.

answered Mar 27 '20 at 10:31

thebluephantom

1 Answers1