https://www.snowflake.com/blog/industry-benchmarks-and-competing-with-integrity/ Skip to content Snowflake Inc. * Platform + Workloads + Platform Overview + Snowflake Data Marketplace + What is the Data Cloud + SNOWDAY Many Data Workloads, One Platform + Data Warehouse Accelerate your analytics with the data platform built to enable the modern cloud data warehouse + Data Lake Improve data access, performance, and security with a modern data lake strategy + Data Engineering Build simple, reliable data pipelines in the language of your choice + Data Science Simple data preparation for modeling with your framework of choice. + Data Applications Simplify developing data-intensive applications that scale cost-effectively, and consistently deliver fast analytics + Data Sharing Share and collaborate on live data across your business ecosystem A Modern Data Platform Find out what makes Snowflake unique thanks to an architecture and technology that enables today's data-driven organizations. Learn More + Architecture + Security and Trust + Pricing What Makes Snowflake Data Marketplace Unique? Securely access live and governed data sets in real time, without the risk and hassle of copying and moving stale data. Learn More Watch Demo Data Cloud: Where Data Thrives Join the ecosystem where Snowflake customers securely share and consume shared data with each other, and with commercial data providers and data service providers. Learn More + Rise of the Data Cloud Podcast + Watch Snowflake Summit 2021 Sessions On-Demand + Become a Member of the Data Cloud Academy SNOWDAY Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Quick Links + 11 Best Practices for Data Engineers + Data Management and the Data Lake: Advantages of a Single Platform Approach + 5 Best Practices for Data Warehouse Development + A Cloud Data Platform for Data Science + How to build powerful data applications + Explore Snowflake Data Marketplace Calculate Your Estimated Benefits of Migrating to Snowflake Get Started I want to... + Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 + Hear from Snowflake customers + Unite my enterprise with a modern cloud data platform + Download Cloud Data Platforms For Dummies + Use one cloud data platform for all my analytic needs + Learn about Snowflake pricing 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now I want to... + Access third-party and personalized data sets + List my data sets and services as a provider + Request new data sets and providers + Watch a tutorial video to get started Improve Marketing Analytics with Snowflake and iKnowlogy Learn More Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 Register Now Watch Snowflake Summit 2021 Keynotes and Breakout Sessions Watch Now * Solutions + Industry Solutions + Department Solutions + Financial Services Personalize customer experiences, improve efficiencies, and better mitigate risk + Advertising, Media & Entertainment Provide highly personalized content and experiences to your consumers + Retail & CPG Deliver 360o, data-driven customer experiences + Healthcare & Life Sciences Build a healthier future with virtually all of your data informing your every decision + Technology Deliver insights, power innovation, and scale effortlessly + Public Sector Use data to power IT modernization, advance your mission, and improve citizen services + Education Leverage data to power educational excellence and drive collaboration + Manufacturing Power innovation through IoT and AI, maximize supply chain efficiency, and improve production quality with data How Snowflake Delivers to the Department Whether its marketing analytics, a security data lake, or another line of business, learn how you can easily store, access, unite, and analyze essentially all your data with Snowflake. + Marketing Analytics Gain 360deg customer views, create relevant offers, and produce much higher marketing ROI + Security Data Lake Empower your cybersecurity and compliance teams with Snowflake. + Product Development Quickly create data-intensive applications without operational overhead Quick Links + Hear from Snowflake customers in my industry + Little Book of Big Success - Financial Services + Learn how Snowflake supports Data Driven Healthcare + Cloud Data Platform for Federal Government Demo Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 Register Here I want to... + Hear from Snowflake customers + Achieve deeper personalization with data + Move from basic to advanced marketing analytics + Learn about Snowflake pricing 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now * Data Marketplace + For Consumers + For Providers Create New Data-Driven Business Insights Access third-party data to provide deeper insights to your organization, and get your own data from SaaS vendors you already work with, directly into your Snowflake account. Learn More The Modern Way to Share and Monetize Your Data Generate more revenue and increase your market presence by securely and instantly publishing live, governed, and read-only data sets to thousands of Snowflake customers. Learn More Quick Links + Request new data sets + Watch a tutorial video + Register for an upcoming hands-on lab Quick Links + Request to become a provider + Modern Data Monetization Strategies + Watch a tutorial video * Partners + Partner Overview + Technology Partners + Services Partners + Cloud Partners + Data Providers + Powered by Snowflake Snowflake Partner Network If you're moving data into Snowflake or extracting insight out of Snowflake, our technology partners and system integrators will help you deploy Snowflake for your success. Learn More Technology Partners Snowflake Technology Partners integrate their solutions with Snowflake, so our customers can easily get data into Snowflake and insights out Snowflake by creating a single copy of data for their cloud data analytics strategy. Learn More Other Programs + Snowpark Accelerated + Snowflake Ready Technology Validation Program Service Partners Snowflake Services Partners provide our customers with trusted and validated experts and services around implementation, migration, data architecture and data pipeline design, BI integration, ETL/ELT integration, performance, running POCs, performance optimization, and training. Learn More Cloud Partners Snowflake is available on AWS, Azure, and GCP in countries across North America, Europe, Asia Pacific, and Japan. Thanks to our global approach to cloud computing, customers can get a single and seamless experience with deep integrations with our cloud partners and their respective regions. Learn More Data Providers As a Snowflake customer, easily and securely access data from potentially thousands of data providers that comprise the ecosystem of the Data Cloud. Also engage data service providers to complete your data strategy and obtain the deepest, data-driven insights possible. LEARN MORE Powered by Snowflake Powered by Snowflake program is designed to help software companies and application developers build, operate, and grow their applications on Snowflake. The program offers technical advice, access to support engineers who specialize in app development, and joint go-to-market opportunities. Learn More Quick Links + Become a Partner + SPN Portal + Partner Code of Conduct + Partner Webinars * Services & Support + Professional Services + Education & Training + Community + Support Snowflake Professional Services Work with Snowflake Professional Services to optimize, accelerate, and achieve your business goals with Snowflake. Learn More Contact Us Other Services + Education & Training + SnowPro Certification + Snowflake Community + Support Education & Training Find the training your team needs to be successful with Snowflake's Data Cloud. Learn More + Instructor-Led Training + On-Demand Training + SnowPro Certification Community Access an ecosystem of Snowflake users where you can ask questions, share knowledge, attend a local user group, exchange ideas, and meet data professionals like you. Learn More + Snowflake Community Login + Community Blog + Data Heroes + Discussions + Stack Overflow + User Groups Support Get the support you need, when you need it, so you can continue to leverage the Snowflake Data Cloud. Learn More Submit a Case + Search for Answers + Documentation + System Status + Releases and Announcements Calculate Your Estimated Benefits of Migrating to Snowflake Get Started * Resources + Resource Library + Events + Webinars + Snowflake Blog + Developers + Rise of the Data Cloud Podcast See all + eBooks + Guides + Data Cloud Academy + Data Warehousing Glossary + Documentation + Patterns + Snowflake Community Events + All Events + User Groups + Snowday, Snowflake's Winter Product Announcement Event | Nov. 16 & 17 Webinars + See All Webinars + Live Demo + Office Hours + Virtual Hands-On Labs + Snowflake on Snowflake Series Snowflake Blog View Blog Snowflake for Developers Snowflake enables you to build data-intensive applications without operational burden. Trusted by fast growing software companies, Snowflake handles all the infrastructure complexity, so you can focus on innovating your own application. Learn More + BUILD: The Data Cloud Dev Summit | October 4-5 + Developer Resources + Developer Guides + Virtual Hands-On Labs + Documentation + Stack Overflow Hear from data leaders to learn how they leverage the cloud to manage, share, and analyze data to drive business growth, fuel innovation, and disrupt their industries. VIEW ALL + Listen on Apple Podcasts + Listen on Spotify + Listen on Simplecast I want to... + Join a virtual hands-on lab + Talk to a Snowflake customer live + Visit the Snowflake Blog + View Snowflake pricing Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now * Company + About + Customers + Careers + Newsroom The Who of Snowflake Learn about the talent behind the technology. A diverse and driven group of business and technology experts are here for you and your organization. Read More + Investor Relations + Leadership & Board + Our Values + Snowflake Ventures + Snowflake for Good Customers + Customer Stories + Data Drivers Awards + Customer Speaker Bureau Careers at Snowflake We challenge ourselves at Snowflake to rethink what's possible for a cloud data platform and deliver on that. We're looking for people who share that same passion and ambition. Current Openings Press and News See Snowflake press releases, Snowflake mentions in the press, and download brand assets. See the Latest Start for Free Get Started Contact Us Contact 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now The Data Is In: The 2020 Snowflake Customer Experience Report Download Now Start for Free * Platform * Solutions * Data Marketplace * Partners * Services & Support * Resources * Company Language Questions? 1-844-766-9355 Language * English * Francais * Deutsch * Ri Ben Yu * hangugeo * Espanol Platform * Workloads * Platform Overview * Snowflake Data Marketplace * What is the Data Cloud * SNOWDAY Workloads Many Data Workloads, One Platform * Data Warehouse * Data Lake * Data Engineering * Data Science * Data Applications * Data Sharing Calculate Your Estimated Benefits of Migrating to Snowflake Get Started Platform Overview A Modern Data Platform Find out what makes Snowflake unique thanks to an architecture and technology that enables today's data-driven organizations. Learn More * Architecture * Security and Trust * Pricing 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now Snowflake Data Marketplace What Makes Snowflake Data Marketplace Unique? Securely access live and governed data sets in real time, without the risk and hassle of copying and moving stale data. Learn More Watch Demo Improve Marketing Analytics with Snowflake and iKnowlogy Learn More What is the Data Cloud Data Cloud: Where Data Thrives Join the ecosystem where Snowflake customers securely share and consume shared data with each other, and with commercial data providers and data service providers. Learn More * Rise of the Data Cloud Podcast * Watch Snowflake Summit 2021 Sessions On-Demand * Become a Member of the Data Cloud Academy Watch Snowflake Summit 2021 Keynotes and Breakout Sessions Watch Now SNOWDAY SNOWDAY Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Watch Snowflake Summit 2021 Keynotes and Breakout Sessions Watch Now Solutions * Industry Solutions * Department Solutions Industry Solutions * Financial Services * Advertising, Media & Entertainment * Retail & CPG * Healthcare & Life Sciences * Technology * Public Sector * Education * Manufacturing Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 Register Here Department Solutions How Snowflake Delivers to the Department Whether its marketing analytics, a security data lake, or another line of business, learn how you can easily store, access, unite, and analyze essentially all your data with Snowflake. * Marketing Analytics * Security Data Lake * Product Development 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now Data Marketplace * For Consumers * For Providers For Consumers Create New Data-Driven Business Insights Access third-party data to provide deeper insights to your organization, and get your own data from SaaS vendors you already work with, directly into your Snowflake account. Learn More For Providers The Modern Way to Share and Monetize Your Data Generate more revenue and increase your market presence by securely and instantly publishing live, governed, and read-only data sets to thousands of Snowflake customers. Learn More Partners * Partner Overview * Technology Partners * Services Partners * Cloud Partners * Data Providers * Powered by Snowflake Partner Overview Snowflake Partner Network If you're moving data into Snowflake or extracting insight out of Snowflake, our technology partners and system integrators will help you deploy Snowflake for your success. Learn More Technology Partners Technology Partners Snowflake Technology Partners integrate their solutions with Snowflake, so our customers can easily get data into Snowflake and insights out Snowflake by creating a single copy of data for their cloud data analytics strategy. Learn More * Snowpark Accelerated * Snowflake Ready Technology Validation Program Services Partners Service Partners Snowflake Services Partners provide our customers with trusted and validated experts and services around implementation, migration, data architecture and data pipeline design, BI integration, ETL/ELT integration, performance, running POCs, performance optimization, and training. Learn More Cloud Partners Cloud Partners Snowflake is available on AWS, Azure, and GCP in countries across North America, Europe, Asia Pacific, and Japan. Thanks to our global approach to cloud computing, customers can get a single and seamless experience with deep integrations with our cloud partners and their respective regions. Learn More Data Providers Data Providers As a Snowflake customer, easily and securely access data from potentially thousands of data providers that comprise the ecosystem of the Data Cloud. Also engage data service providers to complete your data strategy and obtain the deepest, data-driven insights possible. LEARN MORE Powered by Snowflake Powered by Snowflake Powered by Snowflake program is designed to help software companies and application developers build, operate, and grow their applications on Snowflake. The program offers technical advice, access to support engineers who specialize in app development, and joint go-to-market opportunities. Learn More Services & Support * Professional Services * Education & Training * Community * Support Professional Services Snowflake Professional Services Work with Snowflake Professional Services to optimize, accelerate, and achieve your business goals with Snowflake. Learn More Contact Us * Education & Training * SnowPro Certification * Snowflake Community * Support Calculate Your Estimated Benefits of Migrating to Snowflake Get Started Education & Training Education & Training Find the training your team needs to be successful with Snowflake's Data Cloud. Learn More * Instructor-Led Training * On-Demand Training * SnowPro Certification Calculate Your Estimated Benefits of Migrating to Snowflake Get Started Community Community Access an ecosystem of Snowflake users where you can ask questions, share knowledge, attend a local user group, exchange ideas, and meet data professionals like you. Learn More * Snowflake Community Login * Community Blog * Data Heroes * Discussions * Stack Overflow * User Groups Calculate Your Estimated Benefits of Migrating to Snowflake Get Started Support Support Get the support you need, when you need it, so you can continue to leverage the Snowflake Data Cloud. Learn More Submit a Case * Search for Answers * Documentation * System Status * Releases and Announcements Calculate Your Estimated Benefits of Migrating to Snowflake Get Started Resources * Resource Library * Events * Webinars * Snowflake Blog * Developers * Rise of the Data Cloud Podcast Resource Library See all * eBooks * Guides * Data Cloud Academy * Data Warehousing Glossary * Documentation * Patterns * Snowflake Community Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now Events Events * All Events * User Groups * Snowday, Snowflake's Winter Product Announcement Event | Nov. 16 & 17 Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now Webinars Webinars * See All Webinars * Live Demo * Office Hours * Virtual Hands-On Labs * Snowflake on Snowflake Series Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now Snowflake Blog Snowflake Blog View Blog Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now Developers Snowflake for Developers Snowflake enables you to build data-intensive applications without operational burden. Trusted by fast growing software companies, Snowflake handles all the infrastructure complexity, so you can focus on innovating your own application. Learn More * BUILD: The Data Cloud Dev Summit | October 4-5 * Developer Resources * Developer Guides * Virtual Hands-On Labs * Documentation * Stack Overflow Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now Rise of the Data Cloud Podcast Hear from data leaders to learn how they leverage the cloud to manage, share, and analyze data to drive business growth, fuel innovation, and disrupt their industries. VIEW ALL * Listen on Apple Podcasts * Listen on Spotify * Listen on Simplecast Join Snowday, Snowflake's Winter Product Announcement Event Nov. 16 & 17 REGISTER HERE Weekly Demo Register Now Company * About * Customers * Careers * Newsroom About The Who of Snowflake Learn about the talent behind the technology. A diverse and driven group of business and technology experts are here for you and your organization. Read More * Investor Relations * Leadership & Board * Our Values * Snowflake Ventures * Snowflake for Good 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now Customers Customers * Customer Stories * Data Drivers Awards * Customer Speaker Bureau The Data Is In: The 2020 Snowflake Customer Experience Report Download Now Careers Careers at Snowflake We challenge ourselves at Snowflake to rethink what's possible for a cloud data platform and deliver on that. We're looking for people who share that same passion and ambition. Current Openings 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now Newsroom Press and News See Snowflake press releases, Snowflake mentions in the press, and download brand assets. See the Latest 612% ROI? Read Forrester's Total Economic Impact(tm) Study of Snowflake Download Now Inside the data cloud * Around the Company * Thought Leadership * Partner & Customer Value * Industry Solutions * Product & Technology * Data Heroes Community * Subscribe Subscribe to our blog! Thank you for your submission. Close Author Benoit Dageville Benoit Dageville Thierry Cruanes Thierry Cruanes Share * * * * Subscribe Nov 12, 2021 Industry Benchmarks and Competing with Integrity * Thought Leadership + Executive Platform Industry Benchmarks and Competing with Integrity When we founded Snowflake, we set out to build an innovative platform. We had the opportunity to take into account what had worked well and what hadn't in prior architectures and implementations. We saw how we could leverage the cloud to rethink the limits of what was possible. We also focused on ease of use and building a system that "just worked." We knew there were many opportunities to improve upon prior implementations and innovate to lead on performance and scale, simplicity of administration, and data-driven collaboration. In the same way that we had clarity about many things we wanted to do, we also had conviction about what we didn't want to do. One such thing was engaging in benchmarking wars and making competitive performance claims divorced from real-world experiences. This practice is simply inconsistent with our core value of putting customers first. Twenty years ago, the game of leapfrogging benchmark results every few months was a priority for the database industry and both of us were on the front line fighting the benchmark war. Posted results kept getting better and new world records were being set on a regular basis. Most in the industry started adding configuration knobs, special settings, and very specific optimizations that would improve a benchmark by a fraction of a percent. Unfortunately, many such changes translated into additional complexity for customers and, worse, most of them had little or even negative impact on customers' day-to-day workloads. The negative results compound: Development teams are distracted from focusing on what really matters to customers, and users are left underserved with more complex technology. Anyone who has been in the industry long enough can likely attest to the reality that the benchmark race became a distraction from building great products for customers. There is a reason why all the relevant players in the database industry, those that are running the majority of customer workloads, have largely stopped publishing new results. Since founding Snowflake, we have focused on our customers and their workloads, and not on synthetic benchmarks. We're reiterating this philosophy today due to a recent benchmark published by Databricks that included comparisons to Snowflake. Though Databricks' results are under audit as part of the TPC submission process, it's turned the communication of a technical accomplishment into a marketing stunt lacking integrity in its comparisons with Snowflake. The Snowflake results that it published were not transparent, audited, or reproducible. And, those results are wildly incongruent with our internal benchmarks and our customers' experiences. We are therefore sharing our own results but, more importantly, we want to provide guidance on how simple it is to reproduce Snowflake results. We encourage anyone interested in the comparison to do their own assessment, and validate the inaccuracy of the Databricks blog post. The "Trust, but Verify" section later in this blog post shows how this can be achieved with Snowflake, using only a few mouse clicks. This week, we ran the TPC-DS power run in our AWS-US-WEST cloud region. The entire power run consists of running 99 queries against the 100 TB scale TPC-DS database. Out of the box, all the queries execute on a 4XL warehouse in 3,760s, using the best elapsed time of two successive runs.^1 This is more than two times faster than what Databricks has reported as the Snowflake result, while using a 4XL warehouse, which is only half the size of what Databricks indicated it used for its own power run. [hACUaoxCCd] Using an even bigger 5XL warehouse, which is currently in Public Preview, further improves our performance and lowers the total elapsed time to 2,597s. However, because Snowflake already runs these queries so fast on a 4XL, fixed time such as query startup time and synchronization overheads become more pronounced on a 5XL, reducing the speedup we get with that configuration. So for Snowflake, the warehouse size sweet spot at 100 TB is 4XL and not 5XL. The 5XL warehouse size would be useful for higher data volumes, such as 300 TB or 1 PB. In the rest of this blog, all numbers are reported using a 4XL configuration. Finally, note that a Snowflake 4XL warehouse performs similarly to the 3,527s TPC-DS power run that Databricks audited on a much more powerful hardware configuration similar to a 5XL warehouse. Our 5XL in its current form significantly beats Databricks in total elapsed time (2,597s versus 3,527s), and we expect material improvements when it reaches General Availability. The most misleading aspect of the Databricks blog post is how Databricks derives our price/performance. Our Standard Edition on-demand price for a 4XL warehouse run in the AWS-US-WEST cloud region is $256 for an hour. Since Snowflake has per-second billing, the price/performance for the entire power run is $267 for Snowflake, versus the $1,791 Databricks reported on our behalf. Note that there is no need to use our Enterprise Edition to run TPC-DS since materialized views and multi-cluster warehouses are not needed for the benchmark. [5Ax10oWXT9] Using Standard Edition list price, Snowflake matches Databricks on price/performance: $267 versus $275 for the on-demand price of the Databricks configuration used for the 3,527s power run that was submitted to TPC.^2 The numbers above show that even without focusing time and energy on tuning our system to set records for marketing purposes, Snowflake delivers exceptional results. Our price performance is a key reason that our customers are migrating more and more workloads to Snowflake, and we are continuously improving the performance of Snowflake to make real customer workloads run faster, directly translating into overall price/performance improvements for them. In particular, we have many customer workload performance enhancements that are in the process of being released, and we have many more in development. We will continue to stay focused on customer outcomes, not competitive games. Trust, but Verify Anyone who is curious about where we stand regarding TPC-DS should run the benchmark themselves. With Snowflake, it literally only takes a few mouse clicks, about an hour from start to finish, and a few hundred dollars to run the full TPC-DS power test @ 100 TB. Anyone can do this without any prior experience. This is how simple Snowflake is, and a big part of our value proposition beyond just stellar performance. Follow the three simple steps below to run the TPC-DS power run @ 100TB on Snowflake: 1. First, if you are not yet a Snowflake customer, create a new trial account by visiting signup.snowflake.com/. Choose the cloud and region you want for your first Snowflake account; for example, AWS in the US-West Oregon region. Since TPC-DS does not use materialized views or multi-cluster warehouses, simply use our Standard Edition. In a few seconds, you'll receive an email allowing you to log in to your new Snowflake account. 2. Once logged in, you will land on the Snowflake worksheet tab. From there, open the TPC-DS 100 TB tutorial by clicking on the down arrow located on the right side of the worksheet tab named New Worksheet (top left of the screen), then select Open Tutorials, and select Tutorial 4: TPC-DS 100 TB Complete Query Test. This will open a new worksheet tab with the script you can use to run the TPC-DS power run @ 100 TB scale. 3. Run the script that has been loaded by selecting All queries and then by clicking on the Run button. Wait for the entire script to execute; this should take around an hour. If you look at the script, it first creates a 4XL warehouse to run the benchmark, and uses the TPC-DS 100 TB schema from the SNOWFLAKE_SAMPLE_DATA database. This database illustrates the power of data sharing in Snowflake. It was created out of the box by Snowflake and shared with all accounts in all Snowflake cloud regions. No need to pay for its storage and for loading data! The creation of the warehouse should run sub-second and then the queries will start executing against the shared database. At the end of the script, the overall elapsed time and the geometric mean for all the queries is computed directly by querying the history view of all TPC-DS statements that have executed on the warehouse. You should see that metric being reported. Note that results reported in the previous section are on a warm warehouse by running the full query set twice, taking the second run into account. This generally slightly improves the overall performance by about 5%. This illustrates the sheer simplicity and power of Snowflake: After logging into your new Snowflake account, running the entire benchmark only takes four mouse clicks! What's Next Earlier this week, Databricks also announced a change to its service terms enabling competitive benchmarking and publishing of results with clear disclosures, and encouraging others in the industry to do so as well. While we will not be diverting our customer focus to chase synthetic benchmarks, we do agree with Databricks that anyone who publishes benchmarks should do them in a fair, transparent, and replicable manner. We also agree with the exclusion of preview capabilities from being benchmarked. In the end, we want customers to be able to make informed decisions about the capabilities of our platform. As such, we have updated our Acceptable Use Policy to reflect this philosophy. It's disingenuous that in its representation of Snowflake's performance Databricks didn't follow the principles of reproducibility, disclosure, and beta feature testing it's advocating. We hope this perspective is useful, not only for this specific conversation but, more importantly, for the many entrepreneurs out there who get tempted to hop on a benchmark competition that risks distracting from the most crucial goal--innovating for customers' benefit. We are strong believers in competition--the industry gets better and, most importantly, customers reap the technical and economic benefits. But we will focus our competitive efforts on the merit of our technology and the advantages to actual customer workloads. Therefore, we will not publish synthetic industry benchmarks as they typically do not translate to benefits for customers. We know our customers get tremendous value from the capabilities and performance we've delivered, and will be excited about all the additional innovation that is coming. The Snowflake results reported above are derived from the TPC-DS 100 TB power run but are not audited in accordance with TPC policy. --------------------------------------------------------------------- ^1 The difference between a cold and a warm run is about 5%. ^2 The results described in Databricks' blog post do not match the results submitted to the TPC council. Share * * * * Cloud Data Warehousing for Dummies (2nd Edition) Cloud Data Warehousing for Dummies (2nd Edition) Download Snowflake's Cloud Data Warehousing for Dummies and learn how to get the most out of your data with full elasticity. Full Details Read More Snowflake Challenge: Concurrent Load and Query Snowflake Challenge: Concurrent Load and Query In most data warehouses, workloads compete to use the same resources. Snowflake's unique data architecture fixes this issue with concurrent load and query. Find Out More Read More Connect to Snowflake with JDBC Connect to Snowflake with JDBC It is very easy to connect to Snowflake with JDBC, Snowflake walks you through the different steps. Discover Read More What is ETL? What is ETL? ETL stands for 'extract, transform, load', the three processes that move data from one database, multiple databases, or... More to follow Read More * Platform + Cloud Data Platform + Architecture + Pricing + Data Marketplace + Security & Trust * Solutions + Snowflake for Financial Services + Snowflake for Advertising, Media, & Entertainment + Snowflake for Retail & CPG + Snowflake for Healthcare & Life Sciences + Snowflake for Marketing Analytics * Resources + Resource Library + Webinars + Documentation + Community + Procurement + Legal * Explore + News + Blog + Trending + Guides * About + About Snowflake + Investor Relations + Leadership & Board + Snowflake Ventures + Careers + Contact Sign up for Snowflake Communications Thanks for signing up! * Privacy Notice * Site Terms * Cookie Settings (c) 2021 Snowflake Inc. All Rights Reserved * * * * *