MathGroup Archive 2008

[Date Index] [Thread Index] [Author Index]

Search the Archive

A strange precision behavior?


The following two commands result in different values:

SetPrecision[0.01, 50]
0.01`50

Is that because in the first case, 0.01 is first represented as a
double and then passed to SetPrecision, while in the second case,
Mathematica gets a chance to interprete 0.01 as 1/100?

Thanks!

Aaron


  • Prev by Date: Re: Piecewise and multiple values
  • Next by Date: Confused about precision vs accuracy
  • Previous by thread: Re: Piecewise and multiple values
  • Next by thread: Re: A strange precision behavior?