MathGroup Archive 2010

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: Precision of calculations

  • To: mathgroup at smc.vnet.net
  • Subject: [mg109449] Re: Precision of calculations
  • From: Christoph Lhotka <christoph.lhotka at univie.ac.at>
  • Date: Tue, 27 Apr 2010 07:50:55 -0400 (EDT)
  • References: <201004270804.EAA20235@smc.vnet.net>

Hello, you will find the awnser by looking on $MachinePrecision..chr

On 27/04/2010 10:04, Jim Lambaugh wrote:
> Hi guys
>
> When I write numbers in my code, I do it as (e.g.)
>
> 1.0
> 1000.0
> Pi //N
> etc...
>
> Is it correct to say that my calculations are done with machine-
> precision, i.e. with rougly 16 digit precision?
>
> Regards,
> Jim.
>
>
>    



  • Prev by Date: Re: Context Problem
  • Next by Date: Re: InputField Rounding Problem
  • Previous by thread: Precision of calculations
  • Next by thread: Re: Precision of calculations