https://blog.zuthof.nl/2023/06/02/what-makes-intel-optane-stand-out/ Tech Central Tech Central A blog about Virtualization, Cloud and Tech Toggle Navigation * Home * Blog + Apple + Certification + Electronics + Homelab + Linux + Microsoft + Networking + VMware * Privacy Policy * About * Search for: [ ] [Search] What makes Intel Optane stand out Published by Daniel Zuthof on June 2, 2023 Once in a while new hardware is released that makes a difference. Such a device is the Intel Optane series of high-performance SSD's for professional use, which was released in late 2017. In this case I'm talking about the Intel Optane P4800X and P5800X and their consumer counterparts (900P and 905P). All drives are based on the 3D XPoint Technology that Intel co-developed with Micron. [image-6-1024x590] In contrary to regular SSD's, Optane drives like the P5800X brings ultra low latency, high durability and high performance to the table. Effectively Optane is a technology that both has aspects of DRAM and regular NAND based Flash. The downsides of Optane are the high cost and relative low capacity. Combined with the high innovation rate of NAND SSD's and Compute eXpress Link (CXL) around the corner, there was little reason to switch to this pieces of technology for most companies. Finally, Intel decided to stop the innovation of this technology in July 2022 as part of it's IDM 2.0 company strategy. In fact, Intel stopped all their flash storage based activities. This does not mean the drives aren't for sale anymore. Current Optane based products (in SSD and DIMM form) are still being sold. In the beginning of this year even a new Optane Persistent Memory NV-DIMM series 300 (also called PMEM) was released. This new Optane release was needed for the 4th generation of Intel Scalable CPU's code name Sapphire Rapids that was released in January 2023. ServeTheHome made a great video about Optane Persistent Memory if you're not familiar with it. The Gear As part of the VMware vExpert program, I had the opportunity to test a couple of Intel Optane P4800X drives, which I wanted to get my hands on for quite time, being a (hardware) techie. Many thanks to Corey Romero, Matt Mancini, Simon Todd and the Intel Business and Storage BU for making this possible. [intel-p4800x-1024x661] Drive specs Optane P4800X (1st Gen) Optane P5800X (2nd Gen) Capacity 375 GB - 1,5 TB 400 GB - 3,2 TB Release date Q3 2017 Q4 2020 PCIe version PCIe 3.0 (NVMe) PCIe 4.0 (NVMe) Sequential Read 2500 MB/s 7200 MB/s Sequential Write 2200 MB/s 6200 MB/s Read IOPS (4K) 550.000 1.500.000 Write IOPS (4K) 500.000 1.500.000 Durability (DWPD) 30 (Write Intensive) 100 (Write Intensive) Optane Advantages The question arises, what makes Optane drives special compared to NAND based SSD's. When not familiar with this topic, NAND relates to the type of flash chips used on an SSD. Pretty much all (non Optane) SSD's are NAND based. The answer why Optane has advantages over NAND based SSD's can be explained based on a couple of their qualities. * Durability * Data consistency * Performance (in terms of): + Latency + Write Consistency Durability In general the durability of an SSD is an important rating, because it shows how many data can be written to the device during the warranty period. In general the cheaper the SSD, the less data can be written. For examples, when an SSD has only has 3 instead of 5 year of warranty, 40% lesser writes are supported. That's the easy and cheapest way for manufactures to "raise" the durability. Compared to NAND based SSD's, durability is where an Optane drive really shines. So, how does it compares to other professional and consumer drives? SSD Type Power-loss Durability ( Warranty Protection DWPD) QLC based consumer No 0,1 3y TLC based consumer No 0,2 - 0,35 3-5y TLC based prosumer Yes 0,3 - 0,35 5y TLC based professional Yes 1 5y (Read Intensive) TLC based professional Yes 3 5y (Mix Use) MLC / TLC based professional Yes 10 5y (Write Intensive) Optane P4800X Yes 30 5y (1st Gen.) Optane P5800X Yes 100 5y (2nd Gen.) As can be seen in the table above, the Optane is the choice of SSD for high write environments. For a more detailed explanation of SSD durability, check "Comparing Wear Figures on SSDs" blog by Jim Handy (a.k.a. The SSD Guy) to learn more about the numbers that manufacturers throw at you regarding the durability of their drives. Relevant durability terms are: * Drive Writes per Day (DWPD) * Terabytes Written (TBW) * GB/day In the end all terms relate to each other, which shows nicely in the diagram below. [image-1]Source: The SSD Guy Data consistency A second aspect that contributes to durability is data consistency. Professional SSD's (and some consumer ones) have power-loss protection (PLP). PLP is an often overlooked feature of an SSD, that takes care of pending data to be safely stored before the device completely loses power: PLP protects against: * Loss of data in the SSD's cache * Loss or corruption of the SSD mapping table * Page corruption when write cycle would be interrupted PLP can be done in hardware by adding an array of capacitor to the device or in firmware, of which the hardware implementation is preferred. For more info see the link "A Closer Look At SSD Power Loss Protection" from Kingston Memory. [image-3-1024x283]Crucial M500 Consumer drive with hardware PLP. Source: TheSSDReview.com All professional grade SSD's have I've worked with (including Optane) have PLP. Be sure to check your drives for hardware PLP. On the Intel ARK product specification site, hardware PLP for Optane drives translates to the "Enhanced Power Loss Data Protection" feature. [image]Relevant section of P5800X Spec sheet. Performance Performance of an SSD has 2 important aspects. Latency and Write Consistency. Latency Latency is where Optane has a clear advantage over NAND SSD's. Latency is the time the device needs to pull the requested data off it's flash chips and send it to the CPU for processing. [image-2-1024x579] Let's compare Optane drives with current Gen professional NAND based ones. It does not make sense to perform the test myself, since the pro's at Storagereview.com have already done that. [image-4]Optane Read Latency. Source: Storagereview.com [image-5]NAND Read Latency. Source: Storagereview.com The tables above shows it all. IOPS wise, Optane is up-to-par with the competition, but the drive shines when it comes down to latency. It's just astonishing. Being around 25 microsecond (us) per 4K random read for Optane versus 90 to 110 us for NAND based drives. Putting it in perspective, is that every small read on an Optane drive is more than 300% faster. Even up to 1.3 Million IOPS on a single drive. This means that data reaches the CPU faster, but also lowers the load on the CPU because it simply has to wait shorter. Write Consistency (QoS) An Optane drives delivers it's maximum write performance in a consistent way, therefore you could say it's a form or QoS. That's not the case for NAND based drives. A normal NAND based SSD often has DRAM cache or a small part of extra fast flash. This is due to the fact that NAND SSD's can only writes data to empty 4K pages. Therefore empty pages must be available for optimal write performance. Due to it's nature, the erase of a NAND pages takes some time. When most pages are in use or have not been emptied yet (by the garbage collection process), the writes are cached in the DRAM and/or the small of extra fast flash. When that is also filled-up, degradation of write performance occurs for the drive to be able to keep with the garbage collection. In other words, writes are throttled until enough of empty pages are available. Optane does not work this way since it is byte addressable instead of per 4K page. Secondly data can be overwritten directly on Optane devices. Due to these two characteristics, write are always performed with maximum performance, even under continuous heavy write loads. Intended use Due to the reasons above like low latency, consistent (write) performance, high IOPS and high endurance the Optane drives are especially suited for: * Ceph (WAL and Caching) * ZFS (ZIL and SLOG) * QoS advantageous environments * High write environments * High performance databases * VDI environments * vSAN Caching To conclude The Intel Optane drives are well suite for many use cases. Especially those that require (consistent) low latency and high IOPS, combined with a high endurance. On the other hand NAND type SSD are still getting better and a lot of development takes place in that space. Secondly the prices for NAND drives are still dropping to an all time low nowadays. Unfortunately in a couple of years Optane SSD's will be end of sale, since Intel decided to stop it's involvement in the memory space. Nonetheless is still available for a couple of year so we still can enjoy it in SSD or NV-DIMM form factor. By reading this post, I hope you've learned about Optane key architectural differences, SSD Endurance, SSD Power Loss Protectection, write consistency and why those qualities matters. Again many thanks to Corey Romero, Matt Mancini, Simon Todd and the Intel Business and Storage BU for the opportunity. Cheers, Daniel Useful links ServeTheHome: Optane Persistent Memory (NV-DIMM's or also called PMEM ServeTheHome: Compute eXpress Link (CXL) Western Digital: Understanding SSD Endurance TheSSDGuy: Comparing Wear Figures on SSDs Kingston: A Closer Look At SSD Power Loss Protection Storagereview.com: Intel Optane P5800X Review Categories: HomelabStoragevSAN Tags: homelabinteloptanessdstoragevSAN --------------------------------------------------------------------- 2 Comments [bd9472c4] Petar * July 1, 2023 at 8:22 pm This is very important topic because this defines future hardware development. This disks and R/W operations over PCIe cards for direct access with unbelievable performance will be standard IT in next 3-4 years. The topic is thoroughly explained, and results methodically represented, so all praise to the author. Reply [405359c2] Daniel Zuthof * July 2, 2023 at 12:04 am Thanks for your nice feedback, Petar. Appreciated . Reply Leave a Reply Cancel reply Avatar placeholder Your email address will not be published. Required fields are marked * Name *[ ] Email *[ ] Website[ ] [ ] [ ] [ ] [ ] [ ] What's on your mind?[ ] [ ] Save my name, email, and website in this browser for the next time I comment. [Post Comment] [ ] [ ] [ ] [ ] [ ] [ ] [ ] D[ ] Related Posts VMware NSX Homelab Networking NSX Security VMware NSX Tidbits: Fixing failed IDS signature updates In NSX Manager 4.1.x, attempts to update the IDS/IPS signatures failed due to an expired license. The appropriate license, "NSX Firewall with Advanced Thread Prevention," was added, allowing successful signature updates. VMware Code Cloud Director Homelab Linux VMware vSphere vSphere Tidbits: Using ovftool on Linux During re-install of my Cloud Director lab, I noticed that the installation of ovftool (officially named OVF Tool) is not documented. Which seems odd to me, because with 2 variants at hand, it should. In Read more [powercli] Homelab Linux PowerCLI PowerShell VMware PowerCLI 13 installation hurdles on Linux In November 2022, I wrote a post on my endeavor about installing PowerCLI on my Windows box. I needed PowerCLI 13 ImageBuilder feature, which was the only way to add the USB Network Native Driver Read more Hestia | Developed by ThemeIsle