Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in floating-accuracy

Is it possible to get floating point error in this case?

Can I write const expression double that is two ulps less than -0.5

Decimal rounding errors upon division (C#)

Why 4.1%2 returns 0.0999999999999996 using Ruby?But 4.2%2==0.2

ruby floating-accuracy

Minimize floating point inaccuracy in exponential moving average

VC rejecting hexadecimal floating-point constant

Comparing == != in templates

Why isn't to!int() working properly?

Equality check with fractions in Common Lisp

What is the status of tcl_precision?

SQLite query where clause with floating point numbers fails?

Result of casting double to int is wrong

postgresql round half down function

Will (int)pow(n,m) be wrong for some positive integers n,m?

c floating-accuracy

why 1 // 0.05 results in 19.0 in python?

python floating-accuracy

Are there compilers that optimise floating point operations for accuracy (as opposed to speed)?

Handling extremly small numbers in C++

Using floats or doubles instead of ints

lua floating-accuracy

Truncating a double to a float in C

Understanding floating point representation errors; what's wrong with my thinking?