Floating point precision problems when comparing to a RGN

Asked Jan 24 '13 at 22:08

Active Jan 24 '13 at 22:08

Viewed 41 times

Possible Duplicate:
Floating point comparison functions for C#

I've read about all the problems with floating point precision and from what I've read the answer is in rounding. In my situation I have a double that has a value of .07 which actually stores as .070000000000000007. I need to compare .07 to a RGN between 0 and 1 that is also a double. The way I have resolved the problem is to round both numbers to 15 digits and then comapre them. Is this the correct way to do this?

Math.Round(RGN, 15) >= Math.Round(double, 15)

Thanks for the help!!

Gary

edited May 23 '17 at 12:12

Community

asked Jan 24 '13 at 22:08

Gary

1,784
4
18
38

At minimum, `>=` won't do what you want. – Clockwork-Muse Jan 24 '13 at 22:20
Not exactly a duplicate in my opinion, but a good link - +1. – 500 - Internal Server Error Jan 24 '13 at 22:24

Floating point precision problems when comparing to a RGN

0 Answers0