Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in floating-point

Dot Product: * Command vs. Loop gives different results

Relative error and wobble

floating-point

Error in astype float32 vs float64 for integer

converting from struct to float*

Over what range will integer arithmetic addition and subtraction be accurate to the integer in IEEE double precision floating point?

floating-point

Why do two calculations give different answers?

Binary to Float

c floating-point binary

How to chain multiple fma operations together for performance?

c++ c floating-point fma

surprising behaviour for numpy float16 when testing equality

python numpy floating-point

Approximate equality of unordered set of complex floats

Why does Python json module represent floats in dictionary keys as strings?

python json floating-point

What are the implications of constexpr floating-point math?

Guard, round, sticky bits (floating point)

floating-point rounding

How to get decimal precision in python?

python floating-point

How to disable gcc warning "floating constant exceeds range" and "floating constant truncated to zero"?

c gcc floating-point warnings

16 bit Binary conversion

Converting Pytorch bfloat16 tensors to numpy throws TypeError

What does 1.f mean

java floating-point

Converting 4 raw bytes into 32-bit floating point

How can I compute `exp(x)/2` when `x` is large?