[XSL-LIST Mailing List Archive Home] [By Thread] [By Date]

Re: [xsl] real big sourcefile (300MB)

---

---

Konrad,

Typically, most XSLT processors read in your entire source file and build an internal representation in memory. This is often 3-5 times bigger than the original source. In your case, we're talking about 1 gigabyte, or maybe 1.5 gigabyte, of memory. So, your 512MB machine is probably swapping like crazy. Can you hear the disk working?

Try breaking your problem into pieces. Or, if the processing is simple, try writing your own SAX handler that can read the input once through and process it without needing the entire data structure in memory at once.

Good luck.

jeff


Konrad Mader wrote:

Hi,

I try to transform a 300MB-xml-file in a html-file with the xalan-c++ (1.8).
My System (Intel P4, 2.8GHz, 512MB-ram, Win2000) works for days without result.

A 30MB-xml-file is transformed in few seconds.

Is it posibly to handle a 300MB-Source? If yes: how?

thanks!
Konrad

--+------------------------------------------------------------------
XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: <mailto:xsl-list-unsubscribe@xxxxxxxxxxxxxxxxxxxxxx>
--+--

--

-------------------------------------------------------------------------
=    Jeff Kenton      Consulting and software development               =
=                     http://home.comcast.net/~jeffrey.kenton           =
-------------------------------------------------------------------------

---