floating-point

961 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does this numeric equation using a cosine produce a different result between a console application and windows application?
user_181873850
•
5
1
107
visual-studio-2019 .net-core floating-point math c#
If 0.1 can't be represented exactly in binary, why does printing it show "0.1" and not "0.09999999999999998"?
user_34291030
•
2
0
45
floating-point python
How to parse floating point infinity from std::istream
user_42707720
•
5
0
50
floating-point serialization c++
wrong result on adition of numbers larger than epsilon using numpy.float128
user_16551180
•
3
0
87
floating-accuracy floating-point numpy python
Terminology: why "floating multiply-add" instead of "fused multiply-add"?
user_17782750
•
4
1
89
fma language-lawyer floating-point c terminology
Conditional inclusion: integral constant expression is unlimited?
user_17782750
•
2
1
77
constant-expression language-lawyer floating-point c++
Need to calculate the complex log of a double precision float
user_67743920
•
3
3
190
complex-numbers floating-point math c c++
What is the correct way of storing the result of a float expression into an int variable in C?
user_12869700
•
3
4
277
floating-point c types
How does numpy manage to divide float32 by 2**63?
user_179545360
•
1
1
49
floating-accuracy precision floating-point numpy
What is the minimum decimal which can be converted to float and then back to decimal?
user_5074340
•
2
1
76
precision decimal floating-point converters c#
Hot Questions