Pyspark - Fill nans with average of previous and next values

Asked Dec 03 '19 at 09:50

Active Dec 03 '19 at 09:50

Viewed 100 times

I have a dataset in which all the columns are numbers and there are some nans I want to fill. The rows must be seen as a temporal serie, so I want to fill those nans with the average of next and previous values. Is there any way to do it in Pyspark?

Thanks!!

asked Dec 03 '19 at 09:50

Rodrigo Serna Pérez

Sample of data? – pissall Dec 03 '19 at 10:53
Does this answer your question? [Replace missing values with mean - Spark Dataframe](https://stackoverflow.com/questions/40057563/replace-missing-values-with-mean-spark-dataframe) – Oliver W. Dec 03 '19 at 19:49

Pyspark - Fill nans with average of previous and next values

0 Answers0