https://about.fb.com/news/2023/08/seamlessm4t-ai-translation-model/ Skip to content Viewing this site in [English ] Voce esta visualizando este site em [Ingles ] Diese Seite anzeigen auf [Englisch ] Vous consultez ce site en [Anglais ] konosaitowoCi noYan Yu deBiao Shi [Ying Yu ] daeum eoneoro pyosi jung [yeongeo ] Este sitio se esta viendo en [Ingles ] Este sitio se esta viendo en [Ingles ] Meta * Shop[svg] + Menu[svg] o Menu Back * Our technologies[svg] + Menu[svg] o Menu Back * About us[svg] + Menu[svg] o Menu Back * Build with us[svg] + Menu[svg] o Menu Back * Support[svg] + Help Center * Virtual reality + Meta Quest overview + Meta Quest Pro + Meta Quest 2 + Accessories + Apps and games + App Store gift cards + VR experiences * + Meta Portal overview + Meta Portal TV + Meta Portal 10'' + Meta Portal Go + Meta Portal Plus * Smart glasses with Ray-Ban + Ray-Ban Stories overview + Wayfarer + Round + Meteor [vrimg] Virtual reality * Meta Quest overview * Meta Quest Pro * Meta Quest 2 * Accessories * Apps and games * App Store gift cards * VR experiences [sgimg] Smart glasses with Ray-Ban * Ray-Ban Stories overview * Wayfarer * Round * Meteor * Devices + Meta Quest + Meta Portal + Ray-Ban Stories * Apps + Meta Horizon + Facebook + Messenger + Instagram + WhatsApp * Work products + Work tools overview + Virtual reality headsets + Video calling devices + Meta Horizon Workrooms + Workplace * Learn about all technologies Devices * Meta Quest * Meta Portal * Ray-Ban Stories Apps * Meta Horizon * Facebook * Messenger * Instagram * WhatsApp Work products * Work tools overview * Virtual reality headsets * Video calling devices * Meta Horizon Workrooms * Workplace Learn about all technologies * The metaverse * Who we are * Our actions * Our community * News Learn about Meta * Businesses * Creators * Developers * Careers * Investors * Media * Researchers * Engineers * Government, Politics & Advocacy * Nonprofits * Educators * Shop Help Center + Product support home + Meta Quest + Meta Portal + Ray-Ban Stories + Find order * App Help Center + Meta Horizon + Facebook + Messenger + Instagram + WhatsApp + Workplace Shop Help Center * Product support home * Meta Quest * Meta Portal * Ray-Ban Stories * Find order App Help Center * Meta Horizon * Facebook * Messenger * Instagram * WhatsApp * Workplace Search Clear see all results for Close tray Back to Newsroom Meta Introducing SeamlessM4T, a Multimodal AI Model for Speech and Text Translations August 22, 2023August 22, 2023 https://about.fb.com/wp-content/uploads/2023/08/ Seamless-M4T-Translation-Model_Header.mp4 Takeaways * SeamlessM4T is the first all-in-one multilingual multimodal AI translation and transcription model. * This single model can perform speech-to-text, speech-to-speech, text-to-speech, and text-to-text translations for up to 100 languages depending on the task. The world we live in has never been more interconnected, giving people access to more multilingual content than ever before. This also makes the ability to communicate and understand information in any language increasingly important. Today, we're introducing SeamlessM4T, the first all-in-one multimodal and multilingual AI translation model that allows people to communicate effortlessly through speech and text across different languages. SeamlessM4T supports: * Speech recognition for nearly 100 languages * Speech-to-text translation for nearly 100 input and output languages * Speech-to-speech translation, supporting nearly 100 input languages and 36 (including English) output languages * Text-to-text translation for nearly 100 languages * Text-to-speech translation, supporting nearly 100 input languages and 35 (including English) output languages In keeping with our approach to open science, we're publicly releasing SeamlessM4T under a research license to allow researchers and developers to build on this work. We're also releasing the metadata of SeamlessAlign, the biggest open multimodal translation dataset to date, totaling 270,000 hours of mined speech and text alignments. Building a universal language translator, like the fictional Babel Fish in The Hitchhiker's Guide to the Galaxy, is challenging because existing speech-to-speech and speech-to-text systems only cover a small fraction of the world's languages. But we believe the work we're announcing today is a significant step forward in this journey. Compared to approaches using separate models, SeamlessM4T's single system approach reduces errors and delays, increasing the efficiency and quality of the translation process. This enables people who speak different languages to communicate with each other more effectively. https://about.fb.com/wp-content/uploads/2023/08/ 01_Seamless-Multitasking-video.mp4 SeamlessM4T builds on advancements we and others have made over the years in the quest to create a universal translator. Last year, we released No Language Left Behind (NLLB), a text-to-text machine translation model that supports 200 languages, and has since been integrated into Wikipedia as one of the translation providers. We also shared a demo of our Universal Speech Translator, which was the first direct speech-to-speech translation system for Hokkien, a language without a widely used writing system. And earlier this year, we revealed Massively Multilingual Speech, which provides speech recognition, language identification and speech synthesis technology across more than 1,100 languages. SeamlessM4T draws on findings from all of these projects to enable a multilingual and multimodal translation experience stemming from a single model, built across a wide range of spoken data sources with state-of-the-art results. This is only the latest step in our ongoing effort to build AI-powered technology that helps connect people across languages. In the future, we want to explore how this foundational model can enable new communication capabilities -- ultimately bringing us closer to a world where everyone can be understood. Learn more about SeamlessM4T on our AI blog. --------------------------------------------------------------------- Categories : Meta Technology and Innovation Tags: Artificial Intelligence and Machine Learning --------------------------------------------------------------------- Related News Meta Using AI to Translate Speech For a Primarily Oral Language We're developing AI to eliminate language barriers in the physical world and in the metaverse. October 19, 2022October 21, 2022 Topics * Company News * Technology and Innovation * Data and Privacy * Safety and Expression * Combating Misinformation * Economic Opportunity * Election Integrity * Strengthening Communities * Diversity and Inclusion Featured News * Instagram New Ways to Create With Music and Collaborate With Friends on Instagram August 11, 2023 * Meta Introducing AudioCraft: A Generative AI Tool For Audio and Music August 2, 2023 Facebook * Virtual reality + Shop Meta Quest + Refurbished Meta Quest 2 + VR for Good + Forums + Referrals + Blog + Creators + Download SDKs + Developers + Made for Meta partner program + Meta Quest health & safety information + Meta Quest safety center + VR for work * Video calling + Shop Meta Portal + Compare + Features + Private by design + Meta Portal health & safety information * Smart glasses + Shop Ray-Ban Stories + Privacy information + Terms of service + Data policy + Supported countries * About us + About Meta + Media gallery + Brand resources + For investors * Our community + Support SMB + Giving together + Social impact + Business and community growth + VR for Good * Our actions + Data and privacy + Safety and expression + Elections + COVID-19 response + Regulations * Support + Shop Help Center + Order status + Returns + Find a product demo + Legal + Facebook Help Center + Messenger Help Center + Instagram Help Center + WhatsApp Help Center + Workplace Help Center + Meta Quest + Meta Verified Facebook Follow Us facebook icon Instagram icon YouTube icon Twitter icon LinkedIn icon Skip footer menu Skip footer menu Virtual reality * Shop Meta Quest * Refurbished Meta Quest 2 * VR for Good * Forums * Referrals * Blog * Creators * Download SDKs * Developers * Made for Meta partner program * Meta Quest health & safety information * Meta Quest safety center * VR for work Smart glasses * Shop Ray-Ban Stories * Privacy information * Terms of service * Data policy * Supported countries Support * Shop Help Center * Order status * Returns * Find a product demo * Legal * Facebook Help Center * Messenger Help Center * Instagram Help Center * WhatsApp Help Center * Workplace Help Center * Meta Quest * Meta Verified About us * About Meta * Media gallery * Brand resources * For investors Our community * Support SMB * Giving together * Social impact * Business and community growth * VR for Good Our actions * Data and privacy * Safety and expression * Elections * COVID-19 response * Regulations --------------------------------------------------------------------- (c) 2023 Meta Community Standards Data Policy Terms Cookie policy [United States (English)] To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookie Policy I Agree