Large file set problem

Oxygen general issues.
Hradcany
Posts: 1
Joined: Thu Sep 03, 2015 7:30 pm

Large file set problem

Post by Hradcany »

Slightly off topic, but related to Oxygen
I have just received 6000 XML files ranging in size from 500 to 10,000 KB. Using the Saxon Extension:

Code: Select all


 <xsl:for-each select="collection('newdocs?select=*.xml')">
<Item>
<xsl:apply-templates select="saxon:discard-document(.)"/>
</Item>
</xsl:for-each>
I attempted to read them in (the extension marks a processed document for garbage collection but does not actually discard it) and ran out of memory. What I would like to do is break the collection into 500 file sets and try to deal with them that way. Is there some way to select and move a specific number of files from one directory to another vial XSLT or any other means (Windows 10, 64 bit)?
Radu
Posts: 9046
Joined: Fri Jul 09, 2004 5:18 pm

Re: Large file set problem

Post by Radu »

Hi,

Sorry about the delay. This is more of a question for the Saxon users list.
There seemed to be a workaround for discarding documents read using the collection function here:

http://www.dpawson.co.uk/xsl/rev2/docum ... #d15120e88

but I'm not sure if this works or not.

Regards,
Radu
Radu Coravu
<oXygen/> XML Editor
http://www.oxygenxml.com
Post Reply