MathGroup Archive 2013

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: gives 919.8359999999999?`

  • To: mathgroup at smc.vnet.net
  • Subject: [mg132103] Re: gives 919.8359999999999?`
  • From: Bob Hanlon <hanlonr357 at gmail.com>
  • Date: Fri, 6 Dec 2013 02:15:45 -0500 (EST)
  • Delivered-to: l-mathgroup@mail-archive0.wolfram.com
  • Delivered-to: l-mathgroup@wolfram.com
  • Delivered-to: mathgroup-outx@smc.vnet.net
  • Delivered-to: mathgroup-newsendx@smc.vnet.net
  • References: <20131205080510.023806A20@smc.vnet.net>

This is expected when operating with machine precision and the decimal
numbers do not have exact binary representations.

916.536+3.3//FullForm

919.8359999999999`

916.536+3.3//Rationalize//N//FullForm

919.836`

916.536+3.3//Rationalize[#,0]&//N//FullForm

919.836`


Bob Hanlon



On Thu, Dec 5, 2013 at 3:05 AM, Guillermo Sanchez <
guillermo.sanchez at hotmail.com> wrote:

> FullForm[916.536 + 3.3] gives 919.8359999999999 instead of 919.836?
>
> Guillermo
>
>




  • Prev by Date: Re: LocatorPane and tooltips for the locators
  • Next by Date: Re: gives 919.8359999999999?`
  • Previous by thread: Why FullForm[916.536 + 3.3] gives 919.8359999999999?`
  • Next by thread: Re: gives 919.8359999999999?`