precision

318 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
numpy: minimal absolute value above threshold
user_15804690
•
1
1
76
vectorization precision numpy
Extreme floating point precision number 1.0-(0.1^200) in python
user_50824060
•
2
2
128
precision floating-point python-3.x numpy python
PHP 8 float decimal point different than PHP 7
user_22249050
•
2
1
739
php-8.1 php-7.4 php-8 precision floating-point
Is it better to perform n additions of a floating-point number or one integer multiplication?
user_150459170
•
6
4
419
precision floating-point c++
Python small floats - arithmetic precision
user_104369450
•
3
1
55
ieee-754 precision floating-point python
Endless sine generation in C
user_165872760
•
90
12
10702
trigonometry precision time c performance
How to properly calculate rational by using BigDecimal
user_97246730
•
2
1
68
bigdecimal precision java
Does MATLAB provide a lossless coversion function from double to string?
user_58252940
•
5
2
154
chararray precision matlab type-conversion string
What is precision of MYSQL RAND() function? and how to generate huge random numbers?
user_7470500
•
2
1
86
precision random mysql
Euler-Mascheroni Constant
Admin1
•
4
2
907
floating-accuracy precision math algorithm python
Hot Questions