precision

318 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to convert float to string
user_74453740
•
11
4
22798
go precision floating-point string
BigDecimal not keeping actual value when being returned from Java method
user_105606050
•
5
2
2680
bigdecimal precision java
Formatting floats: returning to default
user_1937890
•
7
4
809
iomanip precision floating-point c++
Why does math.isclose() fail to detect minor differences between very large values?
user_76053670
•
5
1
1122
precision compare python-3.x python equality
Python: Why does the event scheduler keep drifting and is there a way to fix this?
user_105406570
•
4
2
933
scheduler timing precision python
Split range into uniform intervals
user_58606190
•
4
2
297
precision floating-point x86 c++
Tensorflow adding floats gives additional digits
user_103752770
•
3
1
191
tensorflow precision python
Does the julia round function contain an error for large numbers?
user_103169870
•
3
1
508
julia arbitrary-precision digits biginteger precision
Is it possible to set precision for Set<Double>.contains()?
user_25289670
•
8
4
160
precision double set java
Exact representation of integers in floating points
user_6906390
•
3
1
1897
precision floating-point c++
Hot Questions