[XSL-LIST Mailing List Archive Home]
[By Thread]
[By Date]
RE: [xsl] Max size?
Subject: RE: [xsl] Max size? From: Edward.Middleton@xxxxxxxxxxx Date: Wed, 8 Jan 2003 19:02:14 +0900 |
If you are using xalan with large files look at SAX2SAX sample. This uses streaming so it avoids building the data structure for the document as much as possiable. http://xml.apache.org/xalan-j/samples.html#sax2sax If you are working on linux I found libxml2 to have similar performance to MSXML3.0 on files of about 1Meg size but have not tested it on anything larger. It can be found at. http://xmlsoft.org/ Edward Middleton -----Original Message----- From: Peter Finch [mailto:peter@xxxxxxxxxxx] Sent: Wednesday, January 08, 2003 6:39 PM To: xsl-list@xxxxxxxxxxxxxxxxxxxxxx Subject: Re: [xsl] Max size? Hi Heinz, > I have a "hypothetical" question. If I were to generate very large XML > files (upwards of 1 Meg?), would I encounter problems when processing with > XSLT, considering that I would want to sort on various elements. > > We are busy doing some tests and I would be interested to compare our > results to existing findings. (We are using xalan/xercses on Linux). It Depends on your machine, parser and the style sheet, but a 1 Meg XML file should not be a problem. Some of my customers work with BIG files... 10's to 100's of Meg and more (believe it or not). I recently did some work on a 157Meg document. Of all the parsers I tried I have to admit the one from Microsoft (msxsl) flew and used up a relatively small amount of memory so I can recommend it as a place to start looking (Hats off to the guys-n-girls at MS for that one at least). On a Dual AMD1400 with 512meg RAM a 13 Meg XML 5 Seconds and a 157 Meg XML file took about 4 minutes with memory usage peeking around 380Meg. It's all about memory as (I think) most of the parsers build a tree in memory before they starting to processes the transformations. I'm pretty sure most of the Java based pasers will have no trouble with a 1Meg(ish) document. I hope this helps. Cheers, Peter -- ___ (OvO) /:::\ \|:|/ /--m-m--------------------------------+ | Peter Finch (p.finch@xxxxxxxxxxx) | | Home Planet Software | | http://www.homepla.net/ | /-------------------------------------/ XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
Current Thread |
---|
|
<- Previous | Index | Next -> |
---|---|---|
RE: [xsl] Max size?, Edward . Middleton | Thread | RE: [xsl] Max size?, Michael Kay |
RE: [xsl] Best practice for "walki, Andrew Welch | Date | [xsl] format number mask, Joeri Belis |
Month |