Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

New posts in floating-point

Which floating point operations generate quiet/signalling NaN?

floating-point nan ieee-754

What is the best way to deal with floating point errors?

Floating point precision for currency: using "round" function in MySQL query vs PHP vs Javascript

how to declare global float register for ARMCC

`float` vs `double` in casual single computations?

floating-point

Python - How to round down a float to 1 significant digit

python floating-point

CUDA float addition gives wrong answer (compared to CPU float ops) [closed]

Unrelated code changes results of calculation

float_t and double_t format specifiers

Python3.7.1: `10**3.5`: could not convert string to float: 3.5

floating and integers....?

Arbitrary precision Float numbers on JavaScript

How should I interpret the ASN.1 BER standard for REALs?

How is the result of this single-precision operation rounded? [Or why is this bit 1 and not 0?]

c floating-point

How do I specify in which direction to round the average of two floats that differ by the LSB of their significand?

Issue with float multiplication and evaluation

php casting floating-point

Rounding to the nearest integer in floating point

Is there a floating point value of x, for which x-x == 0 is false?

Does casting to or from a double and a float preserve infinity and NaN?

c++ floating-point nan

With pairwise summation, how many terms do I need to get an appreciably wrong result?