https://www.phoronix.com/news/Intel-AVX-512-Quicksort-Numpy Phoronix * Articles & Reviews * News Archive * Forums * Premium * Categories * Computers * Display Drivers * Graphics Cards * Linux Gaming * Memory * Motherboards * Processors * Software * Storage * Operating Systems * Peripherals * Close * * Articles & Reviews * News Archive * Forums * Premium * Contact * Categories Computers Display Drivers Graphics Cards Linux Gaming Memory Motherboards Processors Software Storage Operating Systems Peripherals * [ ] [Search] Show Your Support: Did you know that you can get Phoronix Premium for under $4 per month? Try it today to view our site ad-free, multi-page articles on a single page, and more while the proceeds allow us to write more Linux hardware reviews. At the very least, please disable your ad-blocker. Intel Publishes Blazing Fast AVX-512 Sorting Library, Numpy Switching To It For 10~17x Faster Sorts Written by Michael Larabel in Intel on 15 February 2023 at 04:00 PM EST. 3 Comments INTEL Intel recently published an open-source C++ header file library for high performance SIMD-based sorting, which initially is focused on providing a lightning fast AVX-512 quicksort implementation. As of today that code has been merged to Numpy and is providing some 10~17x speed-ups. Toward the end of last year Intel quietly made available x86-simd-sort via their GitHub account. It's a C++ header file library for high performance SIMD sorting though in its current form is just focused on an AVX-512 quicksort implementation. There hasn't been much coverage of this x86-simd-sort project and the GitHub page itself doesn't do much to talk up the crazy fast performance potential of AVX-512 for sorting... But now by way of the widely-used Numpy open-source project, there is prominent use of it and achieving some staggering results. Merged today into Numpy was PR 22315 to vectorize the quicksort for 16-bit and 64-bit data types using AVX-512. On an Intel Tigerlake system this sped-up 16-bit int sorting by 17x while float 64-bit sorting by nearly 10x for random arrays and 32-bit data types were 12~13x faster sorts. This Numpy change was made by Intel engineer Raghuveer Devulapalli and is leveraging the x86-simd-sort code. Intel and AMD AVX-512 enabled processors A speed-up worth celebrating... From multi-vendor support to more efficient AVX-512 implementations on newer processors to more robust software use, there is a lot to enjoy around AVX-512 these days. A 10~17x speed-up for sorting with AVX-512 is pretty astonishing, especially when factoring in the better AVX-512 efficiencies with recent generations of Intel CPUs. With the latest Xeon Scalable processors the thermal and power impact of AVX-512 is no longer too great or causing significant CPU down-clocking as it was panned for in the past, but is in rather good shape. See my recent Intel Xeon "Sapphire Rapids" AVX-512 benchmarks that includes the power efficiency It's too bad though that the latest Intel Core client processors no longer are offering AVX-512. Meanwhile over on the AMD side with their Zen 4 processors from the Ryzen 7000 series through the 4th Gen EPYC server processors is (finally) AVX-512 support. It will be interesting to see what other software projects decide to make use of this x86-simd-sort for speedy AVX-512 sorting. It's another notable win for Advanced Vector Extensions 512 similar to how last year simdjson tapped AVX-512 for very fast JSON parsing as something one would normally not think of immediately as a great use-case for AVX-512. 3 Comments Tweet [INS::INS] Related News Intel Posts Updated CPU Microcode For Two More SGX Vulnerabilities, Privilege Escalation Bug Intel Enables Compute-Based Transcoding To DXT5 With Mesa Intel's Mesa Drivers Begin Preparing For The New Xe Kernel Driver Initial Intel Vulkan Video Support Lands In Mesa 23.1 Intel Releases Embree 4.0 With Arc Graphics Support Via SYCL Intel Developing Rust-Based TD-Shim Firmware For Confidential Containers About The Author Michael Larabel Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com. Popular News This Week The Rust Implementation Of GNU Coreutils Is Becoming Remarkably Robust Linux 6.1 Officially Promoted To Being An LTS Kernel KDE Plasma 5.27 Dubbed "The Best Plasma 5 Version Ever" NVIDIA Publishes DLSS Super Resolution SDK 3.1, Including Updated Linux Demo GTK5 Development Likely To Heat Up Following GTK 4.12 Linux Disabling High Resolution Scrolling For Logitech Devices Connected Via USB Zink Lands A Simple Fix To Boost Doom Performance By ~10x GNOME Is Making It Easier To Track Running Background Apps Latest Linux News Intel Publishes Blazing Fast AVX-512 Sorting Library, Numpy Switching To It For 10~17x Faster Sorts systemd 253 Released With Ukify Tool, systemd-cryptenroll Unlocking Via FIDO2 Tokens Ubuntu 23.04 & Debian Prepare For Updated GNOME Triple Buffering Optimization New Driver Aims To Improve MSI Laptop Support On Linux Linux Looks To Retire Itanium/IA64 Support Intel Posts Updated CPU Microcode For Two More SGX Vulnerabilities, Privilege Escalation Bug Linux Fix Coming For Recent Stuttering On AMD Ryzen Due To fTPM RNG Phoronix Premium Valentine's Day Special To Help Support Linux News & Hardware Testing Firefox 110 Released With Better WebGL Performance, GPU-Accelerated 2D Canvas GNOME Shell & Mutter 44 Beta Released With Many Changes Show Your Support, Go Premium Phoronix Premium allows ad-free access to the site, multi-page articles on a single page, and other features while supporting this site's continued operations. Latest Featured Articles TUXEDO OS 2 Being Prepared With Linux 6.0, Updated KDE Desktop & More Embree 4.0 Is Running Well On Intel 4th Gen Xeon Scalable "Sapphire Rapids" Linux Schedutil Governor's Quirky Behavior Persists In 2023 AMD Ryzen Threadripper 3990X Linux Performance After Three Years Noctua NH-L9a-AM5 Low-Profile Heatsink Works Great For 2U AMD Ryzen AM5 Servers Support Phoronix The mission at Phoronix since 2004 has centered around enriching the Linux hardware experience. In addition to supporting our site through advertisements, you can help by subscribing to Phoronix Premium. You can also contribute to Phoronix through a PayPal tip or tip via Stripe. Phoronix Media --------------------------------------------------------------------- * Contact * Michael Larabel * OpenBenchmarking.org Phoronix Premium --------------------------------------------------------------------- * Support Phoronix * While Having Ad-Free Browsing, * Single-Page Article Viewing Share --------------------------------------------------------------------- * Facebook * Twitter * Legal Disclaimer, Privacy Policy, Cookies | Contact * Copyright (c) 2004 - 2023 by Phoronix Media. * All trademarks used are properties of their respective owners. All rights reserved.