MathGroup Archive 2013

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: gives 919.8359999999999?`


This is expected when operating with machine precision and the decimal
numbers do not have exact binary representations.

916.536+3.3//FullForm

919.8359999999999`

916.536+3.3//Rationalize//N//FullForm

919.836`

916.536+3.3//Rationalize[#,0]&//N//FullForm

919.836`


Bob Hanlon



On Thu, Dec 5, 2013 at 3:05 AM, Guillermo Sanchez <
guillermo.sanchez at hotmail.com> wrote:

> FullForm[916.536 + 3.3] gives 919.8359999999999 instead of 919.836?
>
> Guillermo
>
>




  • Prev by Date: Re: LocatorPane and tooltips for the locators
  • Next by Date: Re: gives 919.8359999999999?`
  • Previous by thread: Why FullForm[916.536 + 3.3] gives 919.8359999999999?`
  • Next by thread: Re: gives 919.8359999999999?`