pre·ci·sion
pri-ˈsi-zhən
2
a
: the degree of refinement with which an operation is performed or a measurement stated compare accuracy sense 2b
b
: the accuracy (as in binary or decimal places) with which a number can be represented usually expressed in terms of the number of computer words available for representation
double precision arithmetic permits the representation of an expression by two computer words
1
: adapted for extremely accurate measurement or operation
2
: held to low tolerance in manufacture
3
: marked by precision of execution
Love words? Need even more definitions?
Merriam-Webster unabridged
Share