Replace Null value with 0 in sparkR

Question

Replace column with null value with 0 or any value

For the dataset test, we replace the column SalesQty null value with 0

dataset: test

+---+----+--------+-------------+-------+--------+-----------+
|mon|year|mon_year|location_code|item_no|SalesQty|mmon_year_1|
+---+----+--------+-------------+-------+--------+-----------+
| 11|2012|  112012|         null|   null|    null|       null|
| 11|2012|  112012|         null|   null|    null|       null|
| 11|2012|  112012|         null|   null|    null|       null|
+---+----+--------+-------------+-------+--------+-----------+

test$SalesQty <- when(isNull(test$SalesQty), 0 )

The resulting dataset result:

+---+----+--------+-------------+-------+--------+-----------+
|mon|year|mon_year|location_code|item_no|SalesQty|mmon_year_1|
+---+----+--------+-------------+-------+--------+-----------+
| 11|2012|  112012|         null|   null|    0   |       null|
| 11|2012|  112012|         null|   null|    0   |       null|
| 11|2012|  112012|         null|   null|    0   |       null|
+---+----+--------+-------------+-------+--------+-----------+

score 2 · Answer 1 · answered Jan 06 '16 at 08:12

2

"null" is string.

test$SalesQty <- ifelse(test$SalesQty == "null", 0, test$SalesQty)

answered Jan 06 '16 at 08:12

Shen

183
1
10

Replace Null value with 0 in sparkR

1 Answers1