Ruby benchmarks for DragonflyBSD 2.9, FreeBSD 8.2, Linux Ubuntu 10.10, NetBSD 5.1, NetBSD-Current, OpenBSD 4.8, OpenIndiana 148 reddit / BSD ---------------------------------------------------------------------- taogepacs · 2011-03-06 16:24 As always, benchmarks should be taken with more than a few grains of salt. There are many variables at work here, so should only be viewed as a rough estimate of how systems perform. ---------------------------------------------------------------------- ivoras · 2011-03-06 19:36 The benchmark and its results are strange. For example, threading benchmarks come out as best on systems which are still under a big lock - OpenBSD and DragonflyBSD. The differences in CPU-intensive microbenchmarks such as sorts, montecarlo, pi, ackermann (assuming they are what their names indicate) should be basically either noise or systemic, compiler-induced differences. Much more interesting are the system benchmarks like pathname (assuming it's syscall-based) where Linuxe's faster syscalls are visible. Unfortunately, some of the interesting ones (client / server) were skipped for the majority of the systems. Some other benchmarks, run on this large number of different systems, would be more interesting: sysbench, unixbench, something like this basically: http://jeffr-tech.livejournal.com/5705.html ---------------------------------------------------------------------- X-Istence · 2011-03-06 20:26 If Ruby like Python has a Global Interpreter Lock so that one thread can only execute at one time anyway then the threading benchmarks don't really matter at all. ---------------------------------------------------------------------- [deleted] · 2011-03-07 05:30 > The hardware which is an intel i7 with a dedicated 40GB SSD used for each os with default installs. And he clearly did not align the disks for any OS. Dragonfly probably won because HAMMER is badass and can likely handle this without issue ---------------------------------------------------------------------- LeekyAbstraction · 2011-03-07 15:50 Data no longer available? Anyway, I had a look earlier before they disappeared. It seemed like the majority of the benchmarks execute for a very short time, with the difference between a "winner" and a "loser" being very small. The OS that can create and teardown a process the fastest "wins". It's not even testing Ruby. Filter out all the benchmarks that take less than 1 minute to execute and compare those instead. ---------------------------------------------------------------------- taogepacs · 2011-03-07 18:04 It appears jaimef is updating the benchmarks with more OS's, but they're still available and are linked at the bottom of the text file. [Direct link here](http://linbsd.org:8000). Your assumption about how the benchmarks operate is incorrect however. As you can see from reading one of the samples e.g. [bm_fiber_ring.rb](https://github.com/acangiano/ruby-benchmark- suite/blob/master/benchmarks/micro-benchmarks/bm_fiber_ring.rb), they use a Bench class to do the iterations. I would agree that some different metrics could be used though. Perhaps run each benchmark for x seconds, and then count how many iterations were performed for the duration. Might prove insightful. ---------------------------------------------------------------------- LeekyAbstraction · 2011-03-07 18:51 I see, thanks for the info. I should have known; I've run the benchmark test myself in the past. ---------------------------------------------------------------------- jafour1 · 2011-03-11 08:14 Align the disks on any os? Care to clarify? I used the full 40GB SSD for a clean install of the OS tested. There was no sharing of the SSD with any other OS's or partitions. ---------------------------------------------------------------------- [deleted] · 2011-03-12 04:16 none of those OSes align on the SSD's sector size which is not 512kb like traditional hard drives. This causes a ton of performance loss. Do some googling and you'll see. ---------------------------------------------------------------------- [deleted] · 2011-03-14 17:41 If I'm reading this right, NetBSD, between the two versions, totalled more wins than everything else combined. Pretty impressive, considering that it's designed first for portability and speed is a lower priority.