Precision of calculations
- To: mathgroup at smc.vnet.net
- Subject: [mg109428] Precision of calculations
- From: Jim Lambaugh <lambaugh at gmail.com>
- Date: Tue, 27 Apr 2010 04:04:32 -0400 (EDT)
Hi guys When I write numbers in my code, I do it as (e.g.) 1.0 1000.0 Pi //N etc... Is it correct to say that my calculations are done with machine- precision, i.e. with rougly 16 digit precision? Regards, Jim.
- Follow-Ups:
- Re: Precision of calculations
- From: Christoph Lhotka <christoph.lhotka@univie.ac.at>
- Re: Precision of calculations