0

How can I achieve keys of a grouped spark-dataframe?

And another question:

What does a pyspark.sql.group.GroupedData object include?

Vahid
  • 3,352
  • 2
  • 34
  • 42

1 Answers1

0

How can I achieve keys of a grouped spark-dataframe?

Without aggregating data and collecting the result it is not possible. It would be easier to just:

df.select(grouping_columns).distinct()

What does a pyspark.sql.group.GroupedData object include?

Just the execution plan:

Alper t. Turker
  • 34,230
  • 9
  • 83
  • 115