https://www.news.upveda.in/2023/06/03/openais-sam-altman-shares-insight-into-future-plans-and-challenges/ Sign in Join * Click here - to use the wp menu builder Sign in Welcome!Log into your account [ ]your username [ ]your password [LOG IN] Forgot your password? Create an account Privacy Policy Sign up Welcome!Register for an account [ ]your email [ ]your username [REGISTER] A password will be e-mailed to you. Privacy Policy Password recovery Recover your password [ ]your email [Send My Pass] Search [ ] UpvedaFuel Your Mind with Latest Tech Buzz * AI * Gaming * Apps * Crypto * Innovation * Science & Tech * Offbeat * Testimonials * FAQ * Upveda AI * Press Center * Feedback * Our Editorial Standards * Meet AI Bodhaks * About Us * Contact us Facebook Twitter Pinterest Youtube Instagram Tiktok UpvedaFuel Your Mind with Latest Tech Buzz Meet AI Bodhaks Sign in Welcome! Log into your account [ ]your username [ ]your password [Login] Forgot your password? Get help Create an account Privacy Policy Create an account Welcome! Register for an account [ ]your email [ ]your username [Register] A password will be e-mailed to you. Privacy Policy Password recovery Recover your password [ ]your email [Send My Password] A password will be e-mailed to you. UpvedaFuel Your Mind with Latest Tech Buzz * AI * Gaming * Apps * Crypto * Innovation * Science & Tech * Offbeat * Testimonials * FAQ * Upveda AI * Press Center * Feedback * Our Editorial Standards * Meet AI Bodhaks * About Us * Contact us Facebook Twitter Pinterest Youtube Instagram Tiktok UpvedaFuel Your Mind with Latest Tech Buzz * AI * Gaming * Apps * Crypto * Innovation * Science & Tech * Offbeat More SIGN IN Meet AI Bodhaks [ ] Try "researchers" Search Home AI OpenAI's Sam Altman Shares Insight into Future Plans and Challenges * AI OpenAI's Sam Altman Shares Insight into Future Plans and Challenges By Olivia Chen - June 3, 2023 361 0 [openai-roa] Facebook Twitter Pinterest WhatsApp Linkedin Email Copy URL In an exclusive gathering with Sam Altman, CEO of OpenAI, and a group of developers, discussions revolved around OpenAI's APIs, product strategies, and the societal impact of artificial intelligence (AI). Altman provided valuable insights into the company's plans, shedding light on key takeaways from the conversation. 1. GPU Limitations Impede OpenAI's Progress A prevailing theme throughout the discussion was OpenAI's current dependence on GPUs, causing delays in their short-term plans. Concerns were raised by customers regarding the reliability and speed of the API. Altman acknowledged the issue, attributing much of the problem to GPU shortages. The rollout of the longer 32k context, as well as the scaling of attention beyond O(n^2), faced challenges that necessitated a research breakthrough to accommodate context windows of 100k to 1M tokens. Efficient finetuning methods like Adapters or LoRa were not yet implemented, making the process compute-intensive. Altman assured developers that better support for finetuning and a potential marketplace for community contributed models are in the pipeline. Dedicated capacity offerings were also constrained by GPU availability, requiring customers to commit to a $100k upfront spend to access the service. 2. OpenAI's Near-Term Roadmap Altman shared a provisional near-term roadmap for OpenAI's API, outlining the following objectives: 2023: * Cheaper and faster GPT-4: The company's top priority is reducing the cost of intelligence, aiming to make the APIs more affordable. * Longer context windows: Context windows as extensive as 1 million tokens are plausible in the near future. * Finetuning API: The finetuning API will be expanded to accommodate the latest models, with specific details shaped by developer feedback. * Stateful API: Altman revealed plans for an API version that remembers conversation history, eliminating the need for repetitive token payments. 2024: * Multimodality: Demonstrated with the release of GPT-4, multimodality will be accessible to developers once additional GPUs are available. 3. Plugins Unlikely to be Included in the API Soon Although developers expressed interest in accessing ChatGPT plugins through the API, Altman stated that their release was not imminent. The absence of a product-market fit for plugins, apart from browsing, was cited as the reason for their delay. Altman emphasized that many developers actually desired ChatGPT integration into their apps, rather than the reverse. 4. OpenAI's Commitment to Avoid Competing with Customers Concerns were voiced by several developers regarding potential competition from OpenAI's own products. Altman reassured them that OpenAI would not release products beyond ChatGPT, highlighting the company's commitment to prioritizing their customers' interests. By using ChatGPT internally, OpenAI aims to enhance their APIs based on their own product experiences. While ChatGPT is designed to be a highly intelligent work assistant, OpenAI intends to avoid encroaching on other GPT use-cases. 5. Balancing Regulation and Open Source Altman advocated for the regulation of future AI models. However, he clarified that existing models were not inherently dangerous and cautioned against premature regulation or bans. He emphasized the significance of open source and revealed that OpenAI was contemplating the open-sourcing of GPT-3. Altman cited concerns about the availability of sufficient infrastructure and capabilities for hosting and serving large language models (LLMs) as a factor influencing their decision. 6. Scaling Laws Remain Relevant Contrary to recent claims suggesting the decline of giant AI models, Altman clarified that the scaling laws for model performance continue to hold. OpenAI's internal data affirms that larger models yield better performance. However, the rapid scaling achieved in previous years may not be sustainable going forward. Altman indicated that future model sizes would likely double or triple each year, rather than increasing exponentially. The continued validity of scaling laws has profound implications for the development timeline of artificial general intelligence (AGI). The scaling hypothesis proposes that most of the necessary elements for AGI already exist, and future progress primarily involves scaling existing methods to larger models and datasets. The ongoing applicability of scaling laws suggests shorter timelines for AGI development. SOURCEHumanloop * TAGS * Chatgpt * Future of OpenAI * OpenAI * OpenAI Roadmap * Sam Altman Facebook Twitter Pinterest WhatsApp Linkedin Email Copy URL Previous articleCox Communications Takes Legal Action to Reverse $1 Billion Piracy Liability Verdict, Citing Twitter Terrorism Ruling Next articleWhy Corporate America Still Embraces China: A Tale of Economic Imperatives and Political Obstacles [645096e135d6] Olivia Chen https://www.upveda.in/ Olivia Chen is a software writer at Upveda, focusing on the latest developments in artificial intelligence and machine learning. She previously worked as a data scientist for a major tech company and has published several papers on the topic. In her free time, she enjoys reading science fiction and experimenting with deep learning algorithms. RELATED ARTICLESMORE FROM AUTHOR Unleashing the Power of Chat Interfaces: LangChain's Dominance in LLM Applications AI OPL: OpenAI, Pinecone, and LangChain - The Tech Trio Revolutionizing LLM Development OpenAI Faces Warning from Japanese Privacy Watchdog Regarding Sensitive Data Collection AI Japan's Privacy Watchdog Warns OpenAI Over Data Collection Practices AI-Powered Drone Turns on Operator in Startling Simulation Mishap, US Air Force Reveals AI AI-Powered Drone Attempts to Kill Operator in Simulation Test, US Air Force Reveals LEAVE A REPLY Cancel reply [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Please enter your comment! [ ] Please enter your name here [ ] You have entered an incorrect email address! Please enter your email address here [ ] [ ]Save my name, email, and website in this browser for the next time I comment. [Post Comment] Captcha verification failed! CAPTCHA user score failed. Please contact us! Greystones Parents Unite to Keep Smartphones Away from Primary School Children Irish Town Implements Joint Action to Keep Smartphones Away from Young Students Offbeat Rahul Shrivastav - June 3, 2023 0 In a remarkable display of solidarity, parents in the Irish town of Greystones have come together to implement a collective decision, informing their children... The China Puzzle: Unraveling Corporate America's Fascination with the Middle Kingdom Why Corporate America Still Embraces China: A Tale of Economic Imperatives and Political Obstacles Offbeat Jake Williams - June 3, 2023 0 In the realm of U.S. politics, corporate America usually finds alignment with one or both major parties when it comes to policies that benefit... Appeal Filed: Cox Communications Counters $1 Billion Piracy Verdict with Twitter Terrorism Ruling Cox Communications Takes Legal Action to Reverse $1 Billion Piracy Liability Verdict, Citing Twitter... Offbeat Jake Williams - June 2, 2023 0 Internet service provider Cox Communications is seeking a reversal of the $1 billion piracy liability verdict it faced four years ago, as it submits... Unleashing the Power of Chat Interfaces: LangChain's Dominance in LLM Applications OPL: OpenAI, Pinecone, and LangChain - The Tech Trio Revolutionizing LLM Development AI Olivia Chen - June 2, 2023 0 LangChain, a cutting-edge programming framework designed to harness the power of large language models (LLMs) in applications, has been making significant strides in the... Stalker 2: Heart Of Chornobyl Developer Battles Persistent Cyber-Attacks, Test Materials Exposed Stalker 2: Heart Of Chornobyl Test Materials Leaked, GSC Game World Blames Russian Hackers Gaming Lee Sidney - June 2, 2023 0 GSC Game World, the Ukrainian studio behind the highly anticipated game Stalker 2: Heart Of Chornobyl, has officially confirmed that sensitive test materials for... UpvedaFuel Your Mind with Latest Tech Buzz Upveda AI is a tech news site that provides readers with the latest technological advancements. From AI to robotics, Upveda explores the cutting-edge technology that is shaping our world. The site prides itself on delivering well-researched and insightful tech news stories, written in an engaging and easy-to-understand language. Whether you're a tech enthusiast or just curious about new tech developments, Upveda is the perfect place to fuel your brain with the latest in technology. Instagram Facebook LinkedIn Mail-1 Pinterest Rss Website More from Upveda * Testimonials * FAQ * Upveda AI * Press Center * Feedback * Our Editorial Standards Contact * Meet AI Bodhaks * About Us * Contact us * Terms and Conditions * Privacy * General Data Protection Regulation (GDPR) Policy * RSS * Site Map (c) 2023 Nerd Bird Solutions. All rights reserved. MORE STORIES Greystones Parents Unite to Keep Smartphones Away from Primary School Children Offbeat Irish Town Implements Joint Action to Keep Smartphones Away from Young... Rahul Shrivastav - June 3, 2023 0