Page 1 of 1

Large file set problem

Posted: Thu Sep 03, 2015 7:47 pm
by Hradcany
Slightly off topic, but related to Oxygen
I have just received 6000 XML files ranging in size from 500 to 10,000 KB. Using the Saxon Extension:

Code: Select all


 <xsl:for-each select="collection('newdocs?select=*.xml')">
<Item>
<xsl:apply-templates select="saxon:discard-document(.)"/>
</Item>
</xsl:for-each>
I attempted to read them in (the extension marks a processed document for garbage collection but does not actually discard it) and ran out of memory. What I would like to do is break the collection into 500 file sets and try to deal with them that way. Is there some way to select and move a specific number of files from one directory to another vial XSLT or any other means (Windows 10, 64 bit)?

Re: Large file set problem

Posted: Thu Sep 24, 2015 2:54 pm
by Radu
Hi,

Sorry about the delay. This is more of a question for the Saxon users list.
There seemed to be a workaround for discarding documents read using the collection function here:

http://www.dpawson.co.uk/xsl/rev2/docum ... #d15120e88

but I'm not sure if this works or not.

Regards,
Radu