precision

318 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
C why is the DBL_MANT_DIG macro defined as 53
user_122031850
•
1
1
123
ieee-754 precision floating-point c
Leaflet polygon precision loss on zoom out
user_177335440
•
2
0
141
leaflet polygon zooming precision
Defensive way to compare pandas timedeltas
user_136825590
•
1
0
31
pandas timedelta precision python
Safely convert `float` to `double` without loss of precision
user_1667320
•
2
1
216
precision floating-point java
Why do we need std::numeric_limits::max_digits10?
user_162244370
•
4
4
212
precision floating-point c++
Fsolve precision issue (python)
user_176311550
•
1
1
105
solver precision numpy python
5456.367 -> 5456.367188. Is this because float precision in c?
user_27539130
•
2
2
61
precision c
Making floating point numbers below some tolerance 0.0
user_49458840
•
7
5
153
julia numbers precision floating-point
High precision sum with R involving binomial coefficients and logs
user_51815130
•
2
1
65
binomial-coefficients logarithm precision r
How does -march native affect floating point accuracy?
user_4534360
•
6
2
212
x86-64 precision floating-point c c++
Hot Questions