https://blog.google/technology/developers/gemma-open-models/ Skip to main content The Keyword Gemma: Introducing new state-of-the-art open models Share Twitter Facebook LinkedIn Mail Copy link [https://blog.google/] * Latest stories * Product updates Product updates + Android, Chrome & Play o Android o Chrome o Chromebooks o Google Play o Wear OS by Google + Devices & Services o Chromecast o Fitbit o Google Nest o Pixel + Explore & Get Answers o Gemini o Google Assistant o Maps o News o Search o Shopping + Connect & Communicate o Photos o Translate o Registry + In The Cloud o Docs, Sheets and Slides o Gmail o Google Cloud o Meet o More on the Cloud Blog See all product updates + Android, Chrome & Play o Android o Chrome o Chromebooks o Google Play o Wear OS by Google + Devices & Services o Chromecast o Fitbit o Google Nest o Pixel + Explore & Get Answers o Gemini o Google Assistant o Maps o News o Search o Shopping + Connect & Communicate o Photos o Translate o Registry + In The Cloud o Docs, Sheets and Slides o Gmail o Google Cloud o Meet o More on the Cloud Blog See all product updates * Company news Company news + Outreach & initiatives o Diversity and inclusion o Education o Google.org o Grow with Google o Sustainability o See all + Technology o AI o Developers o Families o Next billion users o Safety and security o See all + Inside Google o Data centers and infrastructure o Doodles o Googlers o Life at Google o See all + Around the globe o Google in Asia o Google in Europe o Google in Latin America o See all + Authors o Sundar Pichai, CEO o Ruth Porat, SVP and CFO o Kent Walker, SVP o See all + Outreach & initiatives o Diversity and inclusion o Education o Google.org o Grow with Google o Sustainability See all + Technology o AI o Developers o Families o Next billion users o Safety and security See all + Inside Google o Data centers and infrastructure o Doodles o Googlers o Life at Google See all + Around the globe o Google in Asia o Google in Europe o Google in Latin America See all + Authors o Sundar Pichai, CEO o Ruth Porat, SVP and CFO o Kent Walker, SVP See all Subscribe Subscribe The Keyword * Latest stories * Product updates Product updates + Android, Chrome & Play o Android o Chrome o Chromebooks o Google Play o Wear OS by Google + Devices & Services o Chromecast o Fitbit o Google Nest o Pixel + Explore & Get Answers o Gemini o Google Assistant o Maps o News o Search o Shopping + Connect & Communicate o Photos o Translate o Registry + In The Cloud o Docs, Sheets and Slides o Gmail o Google Cloud o Meet o More on the Cloud Blog See all product updates * Company news Company news + Outreach & initiatives o Diversity and inclusion o Education o Google.org o Grow with Google o Sustainability o See all + Technology o AI o Developers o Families o Next billion users o Safety and security o See all + Inside Google o Data centers and infrastructure o Doodles o Googlers o Life at Google o See all + Around the globe o Google in Asia o Google in Europe o Google in Latin America o See all + Authors o Sundar Pichai, CEO o Ruth Porat, SVP and CFO o Kent Walker, SVP o See all * Press corner * RSS feed Subscribe Developers Gemma: Introducing new state-of-the-art open models Feb 21, 2024 min read Share Twitter Facebook LinkedIn Mail Copy link [https://blog.google/] Gemma is built for responsible AI development from the same research and technology used to create Gemini models. Jeanine Banks VP & GM, Developer X and DevRel Tris Warkentin Director, Google DeepMind Share Twitter Facebook LinkedIn Mail Copy link [https://blog.google/] The word "Gemma" and a spark icon with blueprint styling appears in a blue gradient against a black background. At Google, we believe in making AI helpful for everyone. We have a long history of contributing innovations to the open community, such as with Transformers, TensorFlow, BERT, T5, JAX, AlphaFold, and AlphaCode. Today, we're excited to introduce a new generation of open models from Google to assist developers and researchers in building AI responsibly. Gemma open models Gemma is a family of lightweight, state-of-the-art open models built from the same research and technology used to create the Gemini models. Developed by Google DeepMind and other teams across Google, Gemma is inspired by Gemini, and the name reflects the Latin gemma, meaning "precious stone." Accompanying our model weights, we're also releasing tools to support developer innovation, foster collaboration, and guide responsible use of Gemma models. Gemma is available worldwide, starting today. Here are the key details to know: * We're releasing model weights in two sizes: Gemma 2B and Gemma 7B . Each size is released with pre-trained and instruction-tuned variants. * A new Responsible Generative AI Toolkit provides guidance and essential tools for creating safer AI applications with Gemma. * We're providing toolchains for inference and supervised fine-tuning (SFT) across all major frameworks: JAX, PyTorch, and TensorFlow through native Keras 3.0. * Ready-to-use Colab and Kaggle notebooks, alongside integration with popular tools such as Hugging Face, MaxText, NVIDIA NeMo and TensorRT-LLM, make it easy to get started with Gemma. * Pre-trained and instruction-tuned Gemma models can run on your laptop, workstation, or Google Cloud with easy deployment on Vertex AI and Google Kubernetes Engine (GKE). * Optimization across multiple AI hardware platforms ensures industry-leading performance, including NVIDIA GPUs and Google Cloud TPUs. * Terms of use permit responsible commercial usage and distribution for all organizations, regardless of size. State-of-the-art performance at size Gemma models share technical and infrastructure components with Gemini, our largest and most capable AI model widely available today. This enables Gemma 2B and 7B to achieve best-in-class performance for their sizes compared to other open models. And Gemma models are capable of running directly on a developer laptop or desktop computer. Notably, Gemma surpasses significantly larger models on key benchmarks while adhering to our rigorous standards for safe and responsible outputs. See the technical report for details on performance, dataset composition, and modeling methodologies. A chart showing Gemma performance on common benchmarks, compared to Llama-2 7B and 13B Responsible by design Gemma is designed with our AI Principles at the forefront. As part of making Gemma pre-trained models safe and reliable, we used automated techniques to filter out certain personal information and other sensitive data from training sets. Additionally, we used extensive fine-tuning and reinforcement learning from human feedback (RLHF) to align our instruction-tuned models with responsible behaviors. To understand and reduce the risk profile for Gemma models, we conducted robust evaluations including manual red-teaming, automated adversarial testing, and assessments of model capabilities for dangerous activities. These evaluations are outlined in our Model Card.^1 We're also releasing a new Responsible Generative AI Toolkit together with Gemma to help developers and researchers prioritize building safe and responsible AI applications. The toolkit includes: * Safety classification: We provide a novel methodology for building robust safety classifiers with minimal examples. * Debugging: A model debugging tool helps you investigate Gemma's behavior and address potential issues. * Guidance: You can access best practices for model builders based on Google's experience in developing and deploying large language models. Optimized across frameworks, tools and hardware You can fine-tune Gemma models on your own data to adapt to specific application needs, such as summarization or retrieval-augmented generation (RAG). Gemma supports a wide variety of tools and systems: * Multi-framework tools: Bring your favorite framework, with reference implementations for inference and fine-tuning across multi-framework Keras 3.0, native PyTorch, JAX, and Hugging Face Transformers. * Cross-device compatibility: Gemma models run across popular device types, including laptop, desktop, IoT, mobile and cloud, enabling broadly accessible AI capabilities. * Cutting-edge hardware platforms: We've partnered with NVIDIA to optimize Gemma for NVIDIA GPUs, from data center to the cloud to local RTX AI PCs, ensuring industry-leading performance and integration with cutting-edge technology. * Optimized for Google Cloud: Vertex AI provides a broad MLOps toolset with a range of tuning options and one-click deployment using built-in inference optimizations. Advanced customization is available with fully-managed Vertex AI tools or with self-managed GKE, including deployment to cost-efficient infrastructure across GPU, TPU, and CPU from either platform. Free credits for research and development Gemma is built for the open community of developers and researchers powering AI innovation. You can start working with Gemma today using free access in Kaggle, a free tier for Colab notebooks, and $300 in credits for first-time Google Cloud users. Researchers can also apply for Google Cloud credits of up to $500,000 to accelerate their projects. Getting started You can explore more about Gemma and access quickstart guides on ai.google.dev/gemma. As we continue to expand the Gemma model family, we look forward to introducing new variants for diverse applications. Stay tuned for events and opportunities in the coming weeks to connect, learn and build with Gemma. We're excited to see what you create! POSTED IN: * Developers * AI Read Article --------------------------------------------------------------------- More Information --------------------------------------------------------------------- 1 Google adheres to rigorous data filtering practices to ensure fair evaluation. Our models exclude benchmark data from training sets, ensuring the integrity of benchmark comparisons. Collapse --------------------------------------------------------------------- Related stories * 022422_PMAX_Header_04 Google Ads Gemini models are coming to Performance Max By Pallavi Naresh Feb 22, 2024 * Long_Context_Window_Hero_9 AI What is a long context window? By Chaim Gartenberg Feb 16, 2024 * MSC_Keyword_Cover (3) Safety & Security How AI can strengthen digital security By Phil Venables Royal Hansen Feb 16, 2024 * Shield Safety & Security Working together to address AI risks and opportunities at MSC By Kent Walker Feb 16, 2024 * final_gemini_1.5_blog_header_2096x1182-(1) AI Our next-generation model: Gemini 1.5 By Sundar Pichai Demis Hassabis Feb 15, 2024 * AI Evergreen 1 (1) AI How we're partnering with the industry, governments and civil society to advance AI By Laurie Richardson Feb 14, 2024 * . ( ) ( ) ( ) ( ) ( ) ( ) [newsletter] Let's stay in touch. Get the latest news from Google in your inbox. Subscribe No thanks Follow Us * * * * * * Privacy * Terms * About Google * Google Products * About the Keyword * Help * [English ]