MathGroup Archive 2010

[Date Index] [Thread Index] [Author Index]

Search the Archive

Precision of calculations

  • To: mathgroup at
  • Subject: [mg109428] Precision of calculations
  • From: Jim Lambaugh <lambaugh at>
  • Date: Tue, 27 Apr 2010 04:04:32 -0400 (EDT)

Hi guys

When I write numbers in my code, I do it as (e.g.)

Pi //N

Is it correct to say that my calculations are done with machine-
precision, i.e. with rougly 16 digit precision?


  • Prev by Date: Re: Dynamic evaluation of layered networks
  • Next by Date: InputField Rounding Problem
  • Previous by thread: Re: 3D visulaisation of 3D matrix for a 3D CA
  • Next by thread: Re: Precision of calculations