Properties

precision

Supported By

Applies To

Global environment

Examples

set precision to 100
set precision to 6

Description

The precision property determines or changes the number of fractional digits used when evaluating mathematical operations, as well as mathematical functions, when the mathProcessor is set to "big".

The default value of the precision property is 100.

Notes

The precision property does not affect the formatting of numbers, only the precision of calculations. See the numberFormat property.

The precision property is specific to OpenXION; it is not part of the XION Scripting Language Standard.

See Also

numberFormat, roundingMode, mathProcessor