Subj : Re: Storing 20 million randomly accessible documents in compressed form
To   : comp.programming
From : Jon Harrop
Date : Mon Sep 05 2005 09:56 pm

M.Barren@gmail.com wrote:
> I'm currently writing a program which deals with a massive 20 million
> or more very small xml documents.

XML is typically very verbose. Use your favourite programming language to
load the XML data and then marshal it to disc in binary form and back
again. That is a custom compression algorithm that is likely to greatly
outperform a general-purpose compressor like zip.

-- 
Dr Jon D Harrop, Flying Frog Consultancy
http://www.ffconsultancy.com

.