floating-point

961 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to set CUDA floating-point rounding mode for atomics?
user_7528430
•
2
1
194
atomic cuda floating-point
Can I deterministically sum a vector of arbitrarily arranged floating-point numbers?
user_7528430
•
6
3
314
deterministic floating-point math algorithm
Is x%(1e9 + 7) and x%(10**9 + 7) different in Python? If yes, why?
user_22289170
•
8
1
381
floating-point python-3.x python
git installation failing, windows 10, CryptStringToBinaryW
user_1062610
•
2
2
65
motherboard windows-10 floating-point cpu git
Why is Java's double/float Math.min() implemented this way?
user_113106160
•
70
4
5264
floating-point java
Print floating point numbers with variable precision
user_125188410
•
3
2
190
precision floating-point python-3.x python
Correctly rounded computation of sqrt of sum of two floats handling overflow
user_18148810
•
2
3
267
numerical-methods precision floating-point language-agnostic
R vs Python differences in floating point resolution : Is it possible to set Python act like R?
user_91314160
•
3
0
233
floating-accuracy linear-algebra floating-point r python
Why is 5726718050568503296 truncated in JS
user_2513110
•
9
1
243
ieee-754 floating-point javascript
How does the bit layout of the floats give me certain values after bit shifting?
user_156768950
•
2
2
139
bit bit-shift floating-point c
Hot Questions