[Date Index] [Thread Index] [Author Index]

Precision of calculations

• To: mathgroup at smc.vnet.net
• Subject: [mg109428] Precision of calculations
• From: Jim Lambaugh <lambaugh at gmail.com>
• Date: Tue, 27 Apr 2010 04:04:32 -0400 (EDT)

Hi guys

When I write numbers in my code, I do it as (e.g.)

1.0
1000.0
Pi //N
etc...

Is it correct to say that my calculations are done with machine-
precision, i.e. with rougly 16 digit precision?

Regards,
Jim.

• Follow-Ups:
  • Re: Precision of calculations
    • From: Christoph Lhotka <christoph.lhotka@univie.ac.at>