[XSL-LIST Mailing List Archive Home] [By Thread] [By Date]

Re: [xsl] Rounding errors in financial app transforms

Subject: Re: [xsl] Rounding errors in financial app transforms
From: David Carlisle <davidc@xxxxxxxxx>
Date: Thu, 26 Jul 2007 14:39:40 +0100

> So the intermediate product has double the precision of the original
> arguments.

er yes exactly, but since xsd::integer/xsd:decimal are high (and in some
implementations arbitrary) precision, doubling the precision is not
exactly relevant. If you do the multiply first it _wont_ overflow it
will just eat your entire memory storing a gazillion digits (perhaps)

David


________________________________________________________________________
The Numerical Algorithms Group Ltd is a company registered in England
and Wales with company number 1249803. The registered office is:
Wilkinson House, Jordan Hill Road, Oxford OX2 8DR, United Kingdom.

This e-mail has been scanned for all viruses by Star. The service is
powered by MessageLabs. 
________________________________________________________________________

Current Thread

Re: [xsl] Rounding errors in financial app transforms, (continued)
- Dimitre Novatchev - 26 Jul 2007 12:57:40 -0000
- Abel Braaksma - 26 Jul 2007 13:06:19 -0000
- David Carlisle - 26 Jul 2007 13:17:16 -0000
  - Justin Johansson - 26 Jul 2007 13:35:41 -0000
    - David Carlisle - 26 Jul 2007 13:40:22 -0000 <=
    - Michael Kay - 26 Jul 2007 13:52:25 -0000
  - Justin Johansson - 26 Jul 2007 13:45:31 -0000
    - Michael Kay - 26 Jul 2007 13:54:56 -0000
    - David Carlisle - 26 Jul 2007 14:38:56 -0000

<- Previous	Index	Next ->
Re: [xsl] Rounding errors in financ, Justin Johansson	Thread	RE: [xsl] Rounding errors in financ, Michael Kay
Re: [xsl] Rounding errors in financ, Justin Johansson	Date	Re: [xsl] Rounding errors in financ, Justin Johansson
	Month

© 2002-2008 SyncRO Soft Ltd. All rights reserved.
                                             | Sitemap | Privacy Policy 
 This website was created & generated with
                                             <oXygen/> XML Editor