precision

318 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does casting to float produce correct result in java?
user_80869740
•
7
3
366
precision java
Divide an unsigned long for a size_t and assign the result to a double
user_41108260
•
3
3
2112
arbitrary-precision precision c++11 c++
ULP unit of least precision
user_76867770
•
5
2
4515
fractions precision math testing
Working with small probabilities, via logs
user_16622680
•
12
1
376
logarithm precision algorithm
Golang converting float64 to int error
user_3107830
•
6
1
3006
go precision floating-point
Does ARM support SIMD operations for 64 bit floating point numbers?
user_60751890
•
4
2
1826
arm simd precision
How can I decode f16 to f32 using only the stable standard library?
user_42558420
•
6
1
593
rust precision floating-point
Big Decimal Comparison in Java
user_43446180
•
3
4
1286
bigdecimal precision decimal comparison java
How to print double with all decimals in Qt?
user_9784860
•
5
2
10156
precision double qt c++
How to force python float operation on float32 rather than float64?
user_9363320
•
7
2
32085
precision floating-point numpy python operators
Hot Questions