floating-point

961 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to efficiently perform double/int128 conversions with AVX2?
user_185141530
•
2
0
122
avx floating-point-conversion simd floating-point c++
SwiftUI String formatting is rounding my values to nearest whole number?
user_107888180
•
3
2
37
swiftui floating-point division
Flowchart to determine whether the given input number is an integer or a floating point?
user_197298350
•
1
0
57
flowchart pseudocode floating-point integer
What is the rounding rule when the last digit is 5 in .NET?
user_149275070
•
45
2
4443
console.writeline floating-point rounding .net c#
Is checking the location of the sign bit enough to determine endianness of IEEE-754 float with respect to integer endianness?
user_61772530
•
6
1
105
ieee-754 endianness floating-point portability c++
Match negative/positive float/int regex - is it evil?
user_93073920
•
2
1
50
numbers floating-point integer regex
Assign a decimal value to a REAL8 local variable using MASM
user_28011870
•
1
1
44
masm ieee-754 x86-64 floating-point assembly
How to sort a nested list based on a list of floats
user_162272350
•
1
2
44
nested-lists floating-point numpy sorting python
Why/how is (-1) ** 0.5 inaccurate?
user_126710570
•
3
1
78
complex-numbers floating-accuracy floating-point python
Floating point inaccuracies breaks idempotence in weird ways
user_92427100
•
4
0
126
ieee-754 precision floating-point c++
Hot Questions