Re: strange rounding result
- To: mathgroup at smc.vnet.net
- Subject: [mg80956] Re: [mg80918] strange rounding result
- From: "Chris Chiasson" <chris at chiasson.name>
- Date: Thu, 6 Sep 2007 05:28:59 -0400 (EDT)
- References: <200709050659.CAA27251@smc.vnet.net> <46DEBCD2.5030501@wolfram.com>
On 9/5/07, Carl Woll <carlw at wolfram.com> wrote: <snip/> > I think the following explains it: > > In[144]:= N[ > FromDigits[#, 2] & /@ > RealDigits[{999.5, 99.95, 9.995, .9995}, 2], 20] > > Out[144]= {999.50000000000000000, 99.950000000000002842, > 9.9949999999999992184, 0.99950000000000005507} ^^^ Woll FTW (again!) Thanks! (FTW is slang for, "For The Win") -- http://chris.chiasson.name/
- References:
- strange rounding result
- From: "Chris Chiasson" <chris@chiasson.name>
- strange rounding result