floating-point

961 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why conversion (unsigned long long)DBL_MAX (or FLT_MAX) causes raising of FE_INEXACT as well?
user_17782750
•
3
2
124
language-lawyer ieee-754 floating-point exception c
Probable bug in MSVC with compile-time NaN comparison
user_10089570
•
6
0
130
compiler-bug nan floating-point visual-c++ c++
Common method to find index of max element in both Float and Integer array
user_14713140
•
2
5
170
java-8 floating-point integer arrays java
bitwise stochastic rounding
user_147347220
•
2
1
163
stochastic bit-manipulation floating-point rounding c
How to safely round-and-clamp from float64 to int64?
user_11900770
•
3
2
260
integer-overflow floating-point python-3.x numpy
Why do printf and isnan disagree whether a long double value is a NaN?
user_4711640
•
5
1
270
clang floating-point c c++
Understanding Float>>asFraction and its variants
user_9805500
•
8
4
203
fractions smalltalk precision floating-point
Retrieving RGB vector from pixel in Julia
user_102744550
•
4
1
470
julia pixel rgb floating-point
Why is this result more accurate than another result by equivalent functions
user_148585130
•
2
2
239
precision floating-point python
R: how to have gamma() return the actual number instead of Inf
user_33915490
•
2
2
146
floating-point r
Hot Questions