floating-point

961 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
What is the difference between rounding Decimals with quantize vs the built in round function?
user_56897450
•
4
1
377
decimal floating-point rounding python-3.x python
Converges and diverges of Newton's method
user_169607640
•
1
3
122
newtons-method floating-point c
// (floordiv) operator gives wrong result even though fraction is a float-representable integer
user_50014480
•
2
2
90
floating-point python-3.x python
Is cos(x) required to return identical values in different C++ implementations that use IEEE-754?
user_5015570
•
3
1
143
language-lawyer trigonometry floating-point c++
Portable way to check whether a floating point division would end in +-inf
user_90697800
•
3
3
166
floating-point c++11 c++
Numpy matrix multiplication instability across rows
user_11473230
•
2
1
280
matrix-multiplication floating-point numpy arrays python
how to make 69.99*100 print 6999 instead of 6998?
user_5511900
•
2
1
99
floating-point double integer c++
What is a significance of 9.536743e-7?
user_153766400
•
2
1
151
bit precision floating-point python
How many different sums can we get from very few floats?
user_167591160
•
9
2
339
floating-accuracy ieee-754 floating-point math
Java double division positiveness
user_126535320
•
4
3
623
point floating-point division integer java
Hot Questions