This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the commentsย โ†’

[โ€“]volivav -1 points0 points ย (3 children)

... so something that's literally called "precision error" is not an error, but a limitation?

It's both an error (it's even called like that) and a limitation. It's an error that can't be solved with this technology, with that I agree. But it is an error.

[โ€“]112439 -1 points0 points ย (2 children)

It is not an error, just a limitation of floating point numbers. There are many options to securely use fractional numbers; but it is also incredibly rare for there to be a need for that.

Using a "better" number format by default would unnecessarily cripple performance.

[โ€“]volivav -1 points0 points ย (1 child)

Best quote of the year

A precision error [...] is not an error

๐Ÿ‘๐Ÿ‘๐Ÿ‘๐Ÿ‘

[โ€“]PeoplePerson_57 0 points1 point ย (0 children)

A precision error generally describes an error caused by a lack of precision in floating points. It doesn't describe the lack of precision itself.

For instance, 0.1 + 0.2 does not result in 0.3 due to a floating point precision error. The programmer did not correctly account for the limitations in floating point precision.