Services & Resources / Wolfram Forums / MathGroup Archive
-----

MathGroup Archive 2013

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: Precision

  • To: mathgroup at smc.vnet.net
  • Subject: [mg129353] Re: Precision
  • From: Richard Fateman <fateman at cs.berkeley.edu>
  • Date: Mon, 7 Jan 2013 00:38:34 -0500 (EST)
  • Delivered-to: l-mathgroup@mail-archive0.wolfram.com
  • Delivered-to: l-mathgroup@wolfram.com
  • Delivered-to: mathgroup-newout@smc.vnet.net
  • Delivered-to: mathgroup-newsend@smc.vnet.net
  • References: <kc8k2f$b17$1@smc.vnet.net>

On 1/4/2013 11:17 PM, Rob Ryan wrote:
> My frustration is growing. I simply want to add (for example):
> 103971.66+52282.64+2998.27.


InputForm[103971.66+52282.64+2998.27]  gives  159252.56999999998

If you don't like that, use the calculator on your phone (or watch?  do 
people still have watches? Such big ones?)


If this all seems mysterious, read up on floating-point binary numbers .






  • Prev by Date: "Directional" light and ImageScaled coordinates (a bug?)
  • Next by Date: Re: Precision
  • Previous by thread: Re: Precision
  • Next by thread: Re: Precision