[HN Gopher] Python - Writing large ZIP archives without memory i...
___________________________________________________________________
Python - Writing large ZIP archives without memory inflation
Author : sandes
Score : 22 points
Date : 2021-11-20 20:02 UTC (2 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| chrisseaton wrote:
| Does writing ZIP archives usually cause memory inflation? I
| thought the algorithm had a simple fixed-size sliding window?
| TonyTrapp wrote:
| I was thinking the same. Unless you're doing something _really_
| wrong, or if you are intentionally writing to a memory buffer,
| memory consumption of ZIP compression should be minimal across
| the whole process.
| lifthrasiir wrote:
| You do need to keep the central directory record to be written
| at the very end, so it might cause a concern if you have a lot
| of (probably small) files. But Zipfly doesn't seem to solve
| that anyway.
___________________________________________________________________
(page generated 2021-11-20 23:00 UTC)