[HN Gopher] DuckDB quacks Arrow: A zero-copy data integration be...
___________________________________________________________________
DuckDB quacks Arrow: A zero-copy data integration between Arrow and
DuckDB
Author : hfmuehleisen
Score : 54 points
Date : 2021-12-03 19:12 UTC (3 hours ago)
(HTM) web link (duckdb.org)
(TXT) w3m dump (duckdb.org)
| polskibus wrote:
| How does this compare to Postgres + parquet FDW? Is zero copy
| feasible in Postgres with FDWs?
| 1egg0myegg0 wrote:
| I am not very familiar with the Postgres Parquet FDW, but here
| is an educated guess!
|
| Postgres is a row store engine rather than a column store, so I
| believe there will need to be quite a lot of translation for
| Postgres to be able to process parquet data (DuckDB and parquet
| are both columnar). My hypothesis is that DuckDB would be
| significantly faster! However, feel free to benchmark things!
___________________________________________________________________
(page generated 2021-12-03 23:01 UTC)