https://fuse.wikichip.org/news/6102/intels-gracemont-small-core-eclipses-last-gen-big-core-performance/ Skip to content Saturday, August 21, 2021 Latest: * YouTube Accelerates Transcoding * Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling * Intel Unveils Sapphire Rapids: Next-Generation Server CPUs * Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance * Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC * WikiChip Fuse WikiChip Fuse Your Chips and Semi News [ ] * Home * Account * Main Site * Architectures + x86 + ARM + RISC-V + Power ISA + MIPS * Supercomputers * 14 nm * 12nm * 10nm * 7nm * 5nm Architectures Data Processing Unit Desktop Processors Mobile Processors Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance August 19, 2021August 21, 2021 David Schor Alder Lake, Gracemont, Intel, Intel 7, Tremont, x86 [intel-arch-21-gracemont-header] Two years ago Intel introduced Tremont. This was a ground-up new high-efficiency core (E-Core) designed to bring a step-function improvement in both performance and power consumption over the prior generation. The result was a highly dense core that reached Haswell's level of performance. Today, at Intel's 2021 Architecture Day, they introduced its successor - Gracemont. --------------------------------------------------------------------- This article is part of a series of articles covering Intel's 2021 Architecture Day: * Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance * Intel Details Golden Cove For Next-Generation Client and Server CPUs * Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC * Intel Unveils Sapphire Rapids: Next-Generation Server CPUs * Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling * Intel's Mount Evans: Intel's First ASIC DPU * Intel Unveils Xe HPG - Discrete Graphics For Gamers * Intel Unveils Xe HPC And Ponte Vecchio --------------------------------------------------------------------- Overview Gracemont top-level design targets are very similar to Tremont which was the starting point for the new small core. Tremont was set out to be a high energy-efficiency core with 'Core-class' components such as a branch predictor, prefetcher, and other important performance mechanisms. With, Gracemont, Intel took this a step further. Its primary goal was to be the most energy-efficient x86 core to date while providing higher IPC than Intel's previous-generation big core performance - Skylake (which found its way to many other successor SoCs such as Kaby Lake and Coffee Lake). Some other constraints included efficient implementation on Intel 7 for dense implementations such that those cores could be used in relatively large numbers to scale multi-core workloads. Front-End Gracemont builds on the previous Tremont microarchitecture. A significant amount of effort was made in improving the effective instruction stream throughput throughout the core. Intel says that it has significantly beefed up the branch predictor including increasing the BTB to 5K entries. This, in turn, helped keep the instruction pointer queue populated more accurately. Backing up the instruction fetch on Gracemont is a 64 KiB instruction cache. Not only is this double the capacity of Tremont, but it's also the largest instruction cache of any x86 code designed to date. [intel-arch-21-gracemont-fe] The new instruction cache on Gracemont is actually very unique. x86 instruction encoding is all over the place and in the worst (and very rare) case can be as long as 15 bytes long. Pre-decoding an instruction is a costly linear operation and you can't seek the next instruction before determining the length of the prior one. Gracemont, like Tremont, does not have a micro-op cache like the big cores do, so instructions do have to be decoded each time they are fetched. To assist that process, Gracemont introduced a new on-demand instruction length decoder or OD-ILD for short. The OD-ILD generates pre-decode information which is stored alongside the instruction cache. This allows instructions fetched from the L1$ for the second time to bypass the usual pre-decode stage and save on cycles and power. [gracemont-decode] Like Tremont, Gracemont continues with its novel 3-Way Symmetric Decode which can fetch and decode two instruction streams - possibly out-of-order. A hardware-driven load balancer is also capable of taking long chains of sequential instructions and automatically inserts toggle points to ensure parallelism. [intel-arch-21-gracemont-decode] Back-End To increase the data parallelism, the out-of-order window was enlarged to 256 entries. This is actually a huge size for a small core. Gracemont has a large OoO window than both Skylake and Zen 2. It does fall significantly behind Sunny Cove and Golden Cove. x86 uArch ROB Sizes Tremont Gracemont Skylake Sunny Cove Golden Cove Zen 2 Zen 3 CHA 208 256 224 352 512 224 256 192 [intel-arch-21-gracemont-allocate] On the execution engine side, Gracemont went all out on execution units. While Tremont already featured a fairly wide 10-port back-end, Gracemont takes the cake with seventeen individual execution points. On the integer cluster, Gracemont added another integer ALU pipe for a total of 4 ALUs. The four general-purpose integers ALUs are now complemented by a dual multiply/divide pipelines. Additionally, Gracemont can now resolve up to two branches/cycle - double what Tremont was capable of. [intel-arch-21-gracemont-ee] On the vector cluster, Gracemont features three SIMD ALUs which is one more than Tremont. Gracemont ISA supports up to AVX2 or roughly the ISA support level of Haswell. However, Gracemont does incorporate an array of new instructions beyond what Haswell technically supported such as AVX-VNNI for accelerating AI workloads. There is also support for some new security/side-channel analysis mitigation such as Control-Flow Enforcement Technology. Gracemont also doubled the complex pipeline - producing two symmetric FADD and FMUL pipes so it's now possible to execute two independent add or multiply operations per cycle. [intel-arch-21-gracemont-instructions] Memory Subsystem The memory subsystem on Gracemont has been improved. Gracemont doubled the number of AGU pipelines for a total of four. Previously, Tremont had two load/store pipelines, meaning each cycle, an address can be generated for two loads, two stores, or one of each. With Gracemont, there is a dedicated dual load pipeline and a dedicated dual store pipeline. So each cycle, two loads address generation and two stores can be done each cycle. [graceomnt_mem] Gracemont cores are grouped into a quad-core cluster. Multiple instances of that cluster are integrated into the final product. The exact number of clusters (and cores) varies by product. The L2 cache is private to each cluster and is shared by all four cores. An entire cache line (64 bytes) may be sent to the L1 each cycle. The size of the L2 can be either 2 MiB or 4 MiB depending on the actual product. The shared L2 cache features a 64-entry line fill buffer to support all the necessary outstanding misses to the LLC or main memory. [intel-arch-21-gracemont-mem-subsys] A Small Core With Big Performance - Faster Than Last Gen Big Core Gracemont is new and beefier than all prior cores, yet it is said to be extremely powerful and area efficient. "This microarchitecture delivers more general integer IPC than Intel Skylake core while consuming a fraction of the power," said Stephen Robinson, Gracemont Chief Architect. Now, it is important to point out that Skylake was a 14-nanometer product while Gracemont is an Intel 7 product, but regardless that is a pretty big achievement considering they are claiming their latest small core is both lower power and higher performance than the big cores in my laptop from just a few years ago. In terms of latency performance (SPECrate2017_int_base) using a 1C/1T configuration, Intel claims Gracemont achieves 40% higher performance at ISO-power. Alternatively, Intel says that Gracemont consumes less than 40% of the power at ISO-performance. In other words, a Skylake core will require 2.5x the power to achieve the same performance as the Gracemont core. [intel-arch-21-gracemont-latency] Because silicon density was also a big requirement for Gracemont, it's something to take note of. A single Skylake core takes up about the same silicon area as an entire Gracemont quad-core cluster (with the L2 cache). When comparing 2 Skylake cores running 4 threads to a single Gracemont 4-quad cluster, Intel says that the Gracemont cluster achieves 80% more performance while consuming less power. Alternatively, the Gracemont cluster consumes 80% less power at ISO-performance. In other words, it would take Skylake 5x the power to achieve the same performance as the Gracemont cores. [intel-arch-21-gracemont-throughput] --------------------------------------------------------------------- This article is part of a series of articles covering Intel's 2021 Architecture Day: * Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance * Intel Details Golden Cove For Next-Generation Client and Server CPUs * Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC * Intel Unveils Sapphire Rapids: Next-Generation Server CPUs * Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling * Intel's Mount Evans: Intel's First ASIC DPU * Intel Unveils Xe HPG - Discrete Graphics For Gamers * Intel Unveils Xe HPC And Ponte Vecchio --------------------------------------------------------------------- - Spotted an error? Help us fix it! Simply select the problematic text and press Ctrl+Enter to notify us. - * - Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC * Intel Unveils Sapphire Rapids: Next-Generation Server CPUs - Share This Post: Related Articles Intel Launches Desktop Xeon E, Their Fastest Entry-Level Workstation Processors Intel unleashes 8th Gen Core Coffee Lake lineup Intel Introduces 10nm Agilex FPGAs; Customized Connectivity with HBM, DDR5, PCIe Gen 5, and 112G Transceivers A Look at IntelaEUR(tm)s 10nm Std Cell as TechInsights Reports on the i3-8121U, finds Ruthenium ISSCC 2018: Intel's Self-Powered Intelligent IoT Edge Mote ISSCC 2018: Intel's Skylake-SP Mesh and Floorplan Top Six Articles * Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance * Intel Unveils Sapphire Rapids: Next-Generation Server CPUs * Intel Details Golden Cove: Next-Generation Big Core For Client and Server SoCs * YouTube Accelerates Transcoding * Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC * Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling Ezoicreport this ad Recent * YouTube Accelerates Transcoding YouTube Accelerates Transcoding August 21, 2021August 21, 2021 David Schor * Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling August 19, 2021August 19, 2021 David Schor * Intel Unveils Sapphire Rapids: Next-Generation Server CPUs Intel Unveils Sapphire Rapids: Next-Generation Server CPUs August 19, 2021August 19, 2021 David Schor * Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance August 19, 2021August 21, 2021 David Schor * Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC August 19, 2021August 19, 2021 David Schor * Intel Details Golden Cove: Next-Generation Big Core For Client and Server SoCs Intel Details Golden Cove: Next-Generation Big Core For Client and Server SoCs August 19, 2021August 19, 2021 David Schor Ezoicreport this ad Random Picks Samsung M5 Core Details Show Up Samsung M5 Core Details Show Up November 21, 2019May 25, 2021 David Schor IBM Releases Power ISA v3.1; To Present POWER10 At Hot Chips 32 IBM Releases Power ISA v3.1; To Present POWER10 At Hot Chips 32 May 23, 2020May 23, 2021 David Schor The Mesh Network For Next-Generation Neoverse Chips The Mesh Network For Next-Generation Neoverse Chips May 22, 2021May 23, 2021 David Schor Intel Expands 22FFL With Production-Ready RRAM and MRAM on FinFET Intel Expands 22FFL With Production-Ready RRAM and MRAM on FinFET October 18, 2019May 25, 2021 David Schor Intel Launches Desktop Xeon E, Their Fastest Entry-Level Workstation Processors Intel Launches Desktop Xeon E, Their Fastest Entry-Level Workstation Processors July 13, 2018May 25, 2021 David Schor Random Tags 2.5D packaging 3D packaging 5 nm 5nm 7 nm 7nm 10 nm 10nm 12nm 14 nm 16nm AI AMD ARM ARMv8 ARMv9 chiplet Coffee Lake Core i5 Core i7 edge computing EMIB EUV FinFET Foveros GlobalFoundries Hot Chips IBM Ice Lake IEDM inference Intel ISSCC multi-chip package neural processors process technology RISC-V Samsung subscriber only (general) Sunny Cove Supercomputers TSMC VLSI Symposium x86 Zen x86 WorldView All Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling Desktop Processors Mobile Processors Intel Introduces Thread Director For Heterogeneous Multi-Core Workload Scheduling August 19, 2021August 19, 2021 David Schor Intel introduces the Intel Thread Director for heterogeneous multi-core workload scheduling Intel Unveils Sapphire Rapids: Next-Generation Server CPUs Architectures Server Processors Intel Unveils Sapphire Rapids: Next-Generation Server CPUs August 19, 2021August 19, 2021 David Schor Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance Architectures Data Processing Unit Desktop Processors Mobile Processors Intel's Gracemont Small Core Eclipses Last-Gen Big Core Performance August 19, 2021August 21, 2021 David Schor Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC Architectures Desktop Processors Mobile Processors Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC August 19, 2021August 19, 2021 David Schor Intel Details Golden Cove: Next-Generation Big Core For Client and Server SoCs Architectures Desktop Processors Mobile Processors Server Processors Intel Details Golden Cove: Next-Generation Big Core For Client and Server SoCs August 19, 2021August 19, 2021 David Schor Intel Launches 3rd Gen Ice Lake Xeon Scalable Architectures Server Processors Intel Launches 3rd Gen Ice Lake Xeon Scalable April 6, 2021May 23, 2021 David Schor Random Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC Intel Unveils Alder Lake: Next-Generation Mainstream Heterogeneous Multi-Core SoC August 19, 2021August 19, 2021 David Schor VLSI 2018: GlobalFoundries 12nm Leading-Performance, 12LP VLSI 2018: GlobalFoundries 12nm Leading-Performance, 12LP July 22, 2018May 25, 2021 David Schor TSMC 5-Nanometer Update TSMC 5-Nanometer Update November 1, 2019May 25, 2021 David Schor UMC Rolls Out 22-Nanometer UMC Rolls Out 22-Nanometer December 13, 2019May 25, 2021 David Schor Intel Silently Launches Cannon Lake Intel Silently Launches Cannon Lake May 15, 2018May 25, 2021 David Schor Intel Announces Keem Bay: 3rd Generation Movidius VPU Intel Announces Keem Bay: 3rd Generation Movidius VPU November 12, 2019May 25, 2021 David Schor Intel unleashes 8th Gen Core Coffee Lake lineup Intel unleashes 8th Gen Core Coffee Lake lineup April 3, 2018May 25, 2021 David Schor ARM WorldView All Marvell Launches 5nm Octeon 10 DPUs with Neoverse N2 cores, AI Acceleration Data Processing Unit Marvell Launches 5nm Octeon 10 DPUs with Neoverse N2 cores, AI Acceleration June 28, 2021June 28, 2021 David Schor Arm Introduces Its Confidential Compute Architecture Architectures Arm Introduces Its Confidential Compute Architecture June 23, 2021June 23, 2021 David Schor A Look At Trishul: Arm's First High-Density 3D Logic Stacked Test-Chip IEDM 2020 Interconnects Packaging Subscriber Only Content A Look At Trishul: Arm's First High-Density 3D Logic Stacked Test-Chip June 11, 2021June 11, 2021 David Schor Arm Launches New Coherent And SoC Interconnects: CI-700 & NI-700 Architectures Interconnects Network-on-Chip Arm Launches New Coherent And SoC Interconnects: CI-700 & NI-700 May 25, 2021May 25, 2021 David Schor Arm Launches The DSU-110 For New Armv9 CPU Clusters Architectures Interconnects Mobile Processors Arm Launches The DSU-110 For New Armv9 CPU Clusters May 25, 2021May 25, 2021 David Schor Arm Launches Its New Flagship Performance Armv9 Core: Cortex-X2 Architectures Embedded Processors Mobile Processors Arm Launches Its New Flagship Performance Armv9 Core: Cortex-X2 May 25, 2021May 25, 2021 David Schor About WikiChip WikiChip is an independent publisher based in New York. The WikiChip Fuse section publishes chips and semiconductor related news with our main site offering in-depth semiconductor resources and analysis. WikiChip Links * Main Site * WikiChip Fuse * Newsletter * * Main Site * WikiChip Fuse Copyright (c) 2021 WikiChip LLC. All rights reserved. Spelling error report The following text will be sent to our editors: Your comment (optional): [ ] [ ] [ ] Send Cancel