[HN Gopher] Show HN: Benchi - A benchmarking tool written in Go
___________________________________________________________________
Show HN: Benchi - A benchmarking tool written in Go
Benchi is a CLI tool for running benchmarks and collecting metrics.
It's using Docker Compose to orchestrate the infrastructure and
tools being benchmarked, making it repeatable and runnable on
different machines. It allows you to run the same benchmark for
different tools and compare the collected results. The repository
contains a simple example. For a more elaborate example see how we
use Benchi to compare data pipelines running on Conduit and Kafka
Connect, two data streaming tools (still work in progress):
https://github.com/ConduitIO/streaming-benchmarks
Author : lmazgon
Score : 41 points
Date : 2025-04-03 14:28 UTC (8 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| mixologic wrote:
| How do you control for changes in the host os environment that
| would affect performance of the system being observed?
| spockz wrote:
| We solve that partially by running the base state and the delta
| version through concurrently. This way most types of impact
| will impact both at the same time. This gives us the relative
| delta between versions.
|
| Other than that, just like always, run benchmark on a stable
| dedicated set of hardware.
| meling wrote:
| What's the overhead of running in docker vs bare metal?
___________________________________________________________________
(page generated 2025-04-03 23:01 UTC)