TMemDataSet stream write error with huge amount of data
lazarus / 16-Databases

----------------------------------------------------------------------
zeljko · 2019-01-07 12:12

I'm trying to load huge csv file into TMemDataSet, but it crashes
after some time when size of inserted data exceeds MaxInt, each record
is 5453 bytes, when posting 393818 record I have "Stream write error".
Found that it happens when stream size should pass 2GB (maxInt size
exactly). Any idea how to load such data ?
Using fpc-3.0.4 64bit on linux 64bit machine with 32GB of ram, trunk
lazarus.

----------------------------------------------------------------------
zeljko · 2019-01-07 12:45

ok, seem that TBufDataSet works (with usage of
BufDataSet1.MergeChangeLog). So is this bug in TMemDataSet ? Anyone ?