Precision of output
- To: mathgroup at smc.vnet.net
- Subject: [mg48193] Precision of output
- From: spam at husumtoften.invalid (Per Rønne)
- Date: Mon, 17 May 2004 03:22:05 -0400 (EDT)
- Reply-to: spam at husumtoften.dk (Per Rønne)
- Sender: owner-wri-mathgroup at wolfram.com
If I write: N[4209/0.14,100] I get: 30064.3 But if I write N[420900/14,100] I get: 30064.285714285714285714285714285714285714285714285714285714285714285714 285714\ 28571428571428571428571 Why the difference? I thought N determined the number of digitals shown - but I seem to have some problems with this function. And it is not in this example only. TeachersEdition 1.1 with Mathematica 4.2 kernel. -- Per Erik Rønne
- Follow-Ups:
- Re: Precision of output
- From: Andrzej Kozlowski <akoz@mimuw.edu.pl>
- Re: Precision of output