Posts by jcristharif@hachyderm.io
(DIR) Post #AS8xtIjdgWCuB2nCVM by jcristharif@hachyderm.io
2023-01-29T18:11:38Z
0 likes, 1 repeats
@simon I've been researching this a bunch this last week, as I'm trying to do the same for msgspec.It seems like the common solution is to do relative benchmarking, where you compare the main branch with the proposed change, running the benchmarks on both within the same CI run (and then doing some stats to determine if a regression is likely).A few resources I've found useful:- https://labs.quansight.org/blog/2021/08/github-actions-benchmarks- https://asv.readthedocs.io/en/stable/commands.html#asv-continuous