[HN Gopher] Show HN: Slipstream - a python library for stateful ...
___________________________________________________________________
Show HN: Slipstream - a python library for stateful stream
processing
Author : menziess
Score : 9 points
Date : 2025-04-03 20:15 UTC (2 hours ago)
(HTM) web link (slipstream.readthedocs.io)
(TXT) w3m dump (slipstream.readthedocs.io)
| menziess wrote:
| Code: https://github.com/Menziess/slipstream-async
| menziess wrote:
| The link leads to the readthedocs. The library can be used to
| parallelize data processing. `AsyncIterables` can be used a data
| sources, and any `Callable` can be used as a sink. RocksDB is
| used to preserve state. Checkpoints are used to detect stream
| downtimes, which will pause dependent streams until the
| dependency streams have recovered and have caught up.
| woile wrote:
| Looks interesting! Great work! When using cache, if you have 2
| topics, each with multiple partitions. How does the join
| operation works? what if the partitions don't have the same id?
| skadamat wrote:
| Interesting! How do you see this comparing with Bytewax -
| https://github.com/bytewax/bytewax
___________________________________________________________________
(page generated 2025-04-03 23:00 UTC)