Services & Resources / Wolfram Forums / MathGroup Archive

MathGroup Archive 2008

[Date Index] [Thread Index] [Author Index]

Search the Archive

A strange precision behavior?

  • To: mathgroup at
  • Subject: [mg90360] A strange precision behavior?
  • From: Aaron Fude <aaronfude at>
  • Date: Mon, 7 Jul 2008 05:07:02 -0400 (EDT)

The following two commands result in different values:

SetPrecision[0.01, 50]

Is that because in the first case, 0.01 is first represented as a
double and then passed to SetPrecision, while in the second case,
Mathematica gets a chance to interprete 0.01 as 1/100?



  • Prev by Date: Re: Piecewise and multiple values
  • Next by Date: Confused about precision vs accuracy
  • Previous by thread: Re: Piecewise and multiple values
  • Next by thread: Re: A strange precision behavior?