MathGroup Archive 2010

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: Why?


Specify the precision with a number mark "`". You don't have to use N here.

1.000000000000000000000001`60 - 1 
Precision[%] 

1.00000000000000000000000000000000000*10^-24 
36

With less precision:

1.000000000000000000000001`30 - 1 
Precision[%] 

1.00000*10^-24 
6


David Park
djmpark at comcast.net
http://home.comcast.net/~djmpark/  


From: Alexey [mailto:lehin.p at gmail.com] 

Hello,
Consider the following:

In[1]:= N[1.000000000000000000000001 - 1, 60]

Out[1]= 0.*10^-24

I can not understand why this happens. Can anyone explain the reason?
What is about "arbitrary precision arithmetics"?




  • Prev by Date: Re: TableForm questions
  • Next by Date: Re: Why?
  • Previous by thread: Re: TableForm questions
  • Next by thread: Re: Why?