MathGroup Archive 2010

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: Precision of calculations


Hello, you will find the awnser by looking on $MachinePrecision..chr

On 27/04/2010 10:04, Jim Lambaugh wrote:
> Hi guys
>
> When I write numbers in my code, I do it as (e.g.)
>
> 1.0
> 1000.0
> Pi //N
> etc...
>
> Is it correct to say that my calculations are done with machine-
> precision, i.e. with rougly 16 digit precision?
>
> Regards,
> Jim.
>
>
>    



  • Prev by Date: Re: Context Problem
  • Next by Date: Re: InputField Rounding Problem
  • Previous by thread: Precision of calculations
  • Next by thread: Re: Precision of calculations