spark decimal issue - automatically round or truncated the 10th decimal

Asked Jun 12 '20 at 13:40

Active Jun 12 '20 at 13:40

Viewed 601 times

I have a decimal issue but different from this

I have tried to set spark.sql.decimalOperations.allowPrecisionLoss=false. It can fix some of the issues as mentioned in the above question. However, one of the issues can not be solved. After I switched to spark, the number will automatically truncate or round the 10th decimal. I have included two examples shown below:

17749.5500000001 -> 17749.5500000000
17154.2099999999 -> 17154.2100000000

asked Jun 12 '20 at 13:40

Jason LiLy

which spark version are you using ? & how are you trying can you post some code if possible ? – Srinivas Jun 12 '20 at 14:20
Spark 2.4.2; I run spark sql in aws emr. code: (a - b) / 100 * c – Jason LiLy Jun 12 '20 at 19:40

spark decimal issue - automatically round or truncated the 10th decimal

0 Answers0