Subj : What will a next-gen AI PC look like? Intel confirms necessary po To : All From : TechnologyDaily Date : Thu Mar 28 2024 13:15:05 What will a next-gen AI PC look like? Intel confirms necessary power for the NPU itll be fast enough to run Copilot locally Date: Thu, 28 Mar 2024 13:04:36 +0000 Description: Next-gen AI PCs will be seriously powered up to run Copilot on-device rather than via the cloud, in the main. FULL STORY ====================================================================== Microsofts Copilot will be able to run locally on your AI PC in the future, it has been confirmed, as have the hardware requirements in terms of how powerful an NPU ( Neural Processing Unit ) will be required in these AI-focused devices. Toms Hardware reports that at Team Blues AI Summit in Taipei, in a Q&A session, Todd Lewellen, VP of Intels Client Computing Group, confirmed to our sister site that the NPU of a next-gen AI PC will need to reach 40 TOPS (a measurement of processing power in relation to AI tasks). Note that this is the NPU of the next generation of AI PCs an army of devices on the horizon, apparently not the current-gen devices which operate with much lower TOPS than that (well come back to that momentarily). As mentioned, it was further confirmed that in the future Microsofts Copilot AI will be able to run locally on the AI PC which this additional NPU processing power will facilitate, as opposed to needing to be online and tap the power of the cloud for the AI assistants responses. Or at least some, or perhaps a great deal, of Copilot functionality will be handled locally. Lewellen clarified: And as we go to that next gen [AI PC], its just going to enable us to run more things locally, just like they will run Copilot with more elements of Copilot running locally on the client. That may not mean that everything in Copilot is running local, but youll get a lot of key capabilities that will show up running on the NPU. Analysis: Fairly local Running Copilot locally (for at least some, or indeed many, of the AIs functions) means benefiting from faster responses, as having the workload carried out on the laptop itself will mean the AI is nice and snappy. While the cloud is great for heavy lifting, of course, it entails having to wait for things to happen remotely (and is dependent on the whims of your internet connection, as ever, which might be spotty particularly when on the move with a notebook). With much more powerful NPUs in the cards and the incoming Snapdragon X Elite chip promising to deliver 45 TOPS of processing performance, in devices like the Surface Pro 10 due in the middle of the year some big strides forward are about to be taken. To put this in perspective, Intels current Meteor Lake laptop silicon has an NPU offering around 10 TOPS (and Qualcomm has already made it very clear how fast its Snapdragon CPU is for AI workloads). Working locally with Copilot, and not piping data into the cloud, is more secure for obvious reasons its always better to avoid sending your data online, particularly if its sensitive in nature, if you can. And, of course, local processing is better for privacy, too (though if its tight privacy you want, feeding data into and interacting with an AI in any fashion is going to limit that goal, shall we say). Its also worth noting that elsewhere, Intel spilled some further beans on AI PCs and that they wont just be required to have an NPU and Copilot installed, but also the dedicated Copilot key on the keyboard that Microsoft revealed back at the start of 2024. (Well, technically this is a slight gray area but its certainly controversial and we chew over the broader concerns at length here ). A further rumor heard in the past is that AI PCs will require 16GB of system RAM , but that nugget hasnt been confirmed yet. Again, this might be tied up in the aim of running Copilot, or at least much of it, locally on the laptop. You might also like... Watch out: soon some older PCs will lose Windows 11 support Windows 11 is getting a voice-powered ability many users have been longing for Dont make these 5 big mistakes when using Windows 11 ====================================================================== Link to news story: https://www.techradar.com/computing/windows-laptops/what-will-a-next-gen-ai-pc -look-like-intel-confirms-necessary-power-for-the-npu-itll-be-fast-enough-to-r un-copilot-locally --- Mystic BBS v1.12 A47 (Linux/64) * Origin: tqwNet Technology News (1337:1/100) .