floating-accuracy

76 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
zsh loses precision when miltiplying two floats of significantly different magnitude
user_83629820
•
2
2
88
floating-accuracy precision zsh
Precision limits of numpy floats?
user_10191290
•
2
2
420
floating-accuracy precision numpy python types
How many different sums can we get from very few floats?
user_167591160
•
9
2
339
floating-accuracy ieee-754 floating-point math
Is there a way to force numpy.set_printoptions to show the exact float value?
user_118442240
•
4
0
210
floating-accuracy floating-point numpy python
R: Computing maximum floating-point error for log(exp(...))
user_93254130
•
4
3
132
floating-accuracy precision floating-point r
boost.geometry polygon difference returns self intersecting result (or is wrongly detecting it as such)
user_143784800
•
1
1
405
boost-geometry floating-accuracy geometry boost c++
R vs Python differences in floating point resolution : Is it possible to set Python act like R?
user_91314160
•
3
0
233
floating-accuracy linear-algebra floating-point r python
Is it possible to add extra columns to confusion matrix?
user_76577490
•
2
1
330
confusion-matrix scikit-learn floating-accuracy python-3.x python
What range of numbers can I represent using scaled_float in Elasticsearch?
user_11269710
•
3
1
312
elasticsearch floating-accuracy precision limit floating-point
How do I avoid catastrophic cancellation for small numbers in f(x) = (1-cos(x))/x**2 in Python 3.7?
user_152521340
•
2
4
664
floating-accuracy trigonometry python-3.x function python
Hot Questions