How can I achieve keys of a grouped spark-dataframe
?
And another question:
What does a pyspark.sql.group.GroupedData
object include?
How can I achieve keys of a grouped spark-dataframe
?
And another question:
What does a pyspark.sql.group.GroupedData
object include?
How can I achieve keys of a grouped spark-dataframe?
Without aggregating data and collecting the result it is not possible. It would be easier to just:
df.select(grouping_columns).distinct()
What does a pyspark.sql.group.GroupedData object include?
Just the execution plan: