rounding-error

21 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
NLopt minimum working example fails with "RoundoffLimited"
user_200108130
•
1
0
17
nlopt nonlinear-optimization rounding-error numpy python
Rounding in java shows different result
user_27696070
•
3
0
49
rounding-error java
Rust: Strange state-based rounding behaviour on f32
user_86890240
•
3
1
52
rust rounding-error
How to test element's width in cypress when the calculated width isn't accurate?
user_74217760
•
1
3
274
e2e-testing cypress rounding-error testing css
How to calculate sum of reciprocals with integers?
user_80319560
•
4
3
158
rounding-error fractions one-liner integer python
Why does calculated loss differs from logged loss in pytorch_lightning?
user_93097050
•
1
0
206
pytorch-lightning pytorch rounding-error
Exact double division
user_148828620
•
2
2
214
rounding-error floor-division c++
Fixing a Display Rounding Error where different sized tiles & sprites jitter
user_126900250
•
1
0
31
rpgmakermv rounding-error rounding javascript
How is machine epsilon related to floating point rounding error?
user_162244370
•
1
1
640
epsilon rounding-error precision floating-point
MSAccess 2013 odd rounding behavior in queries
user_45820000
•
1
1
34
ms-access-2013 rounding-error sql
Hot Questions