Re: Precision of calculations
- To: mathgroup at smc.vnet.net
- Subject: [mg109455] Re: Precision of calculations
- From: Bob Hanlon <hanlonr at cox.net>
- Date: Tue, 27 Apr 2010 08:47:59 -0400 (EDT)
- Reply-to: hanlonr at cox.net
They start off that way data = {1.0, 1000.0, Pi // N}; Precision /@ data {MachinePrecision,MachinePrecision,MachinePrecision} Precision /@ Gamma[data] {MachinePrecision,12.1834,MachinePrecision} Bob Hanlon ---- Jim Lambaugh <lambaugh at gmail.com> wrote: ============= Hi guys When I write numbers in my code, I do it as (e.g.) 1.0 1000.0 Pi //N etc... Is it correct to say that my calculations are done with machine- precision, i.e. with rougly 16 digit precision? Regards, Jim.