[HN Gopher] NeuralOS: An operating system powered by neural netw...
       ___________________________________________________________________
        
       NeuralOS: An operating system powered by neural networks
        
       Author : yuntian
       Score  : 53 points
       Date   : 2025-07-14 19:54 UTC (3 hours ago)
        
 (HTM) web link (neural-os.com)
 (TXT) w3m dump (neural-os.com)
        
       | yuntian wrote:
       | A generative operating system that directly predicts screen
       | images based on mouse and keyboard inputs, powered by an RNN for
       | state modeling and a diffusion model for image generation.
       | 
       | See my tweet for more details:
       | https://x.com/yuntiandeng/status/1944802154314916331
        
         | 5- wrote:
         | i like how most of your demo video is clicking through various
         | firefox and google popups.
        
       | munchler wrote:
       | I tried to use this but the lag made it impossible to even click
       | on an icon. On top of that, a message that other people were
       | waiting popped up intermittently, pushing the emulation down the
       | page, away from the mouse pointer. I'm not sure what sort of
       | experience you're aiming for, but this probably isn't it.
        
       | 1dom wrote:
       | Tried to use this, also found lag made it basically impossible,
       | and felt uncomfortable being reminded that other people might be
       | waiting for me to get on with it.
       | 
       | However, I was able to click on a folder, it opened and looked
       | fairly convincing. Only indicator that something was off - other
       | than lag - was the at the bottom of the file browser, it
       | mentioned how much diskspace was available: the first digit was
       | clearly 6, the second was flickering and blurring between
       | different numbers.
       | 
       | Pretty interesting idea though. What framerates should it run at?
       | I felt I was getting <5fps.
        
         | Sharlin wrote:
         | I managed to open the terminal, unsurprisingly trying to type
         | something just resulted in hallucinations. And even though
         | menus open and look plausible, clicking the items either didn't
         | do anything or hallucinated some garbage.
        
       | mpascale00 wrote:
       | This brings personal nostalgia to when I was very young and made
       | an "OS" in PowerPoint using links between slides, animations, and
       | the embedded internet explorer object. Similarly, I'm not sure I
       | see any practical use in this. Still it's a really fascinating
       | conceptual demonstration of networks understanding _intent_ in
       | the complex state-machine that is a graphical user interface.
        
       | spogbiper wrote:
       | seems similar to this:
       | https://aistudio.google.com/apps/bundled/gemini_os?showPrevi...
       | 
       | although i wasn't able to really use it due to lag
        
         | yuntian wrote:
         | Actually NeuralOS works very differently from Gemini OS.
         | NeuralOS directly generates each screen at the pixel level
         | entirely from neural networks, while Gemini OS generates code
         | that's then rendered into a traditional UI. This difference is
         | why NeuralOS is much slower and currently runs at a lower frame
         | rate.
        
       | yuntian wrote:
       | Thanks everyone for trying out NeuralOS, and apologies for the
       | frustrating user experience!
       | 
       | I coded up the demo myself and didn't anticipate how disruptive
       | the intermittent warning messages about waiting users would
       | become. The demo is quite resource-intensive: each session
       | currently requires its own H100 GPU, and I'm already using a
       | dispatcher-worker setup with 8 parallel workers. Unfortunately,
       | demand exceeded my setup, causing significant lag and I had to
       | limit sessions to 60 more seconds when others are waiting.
       | Additionally, the underlying diffusion model itself is slow to
       | run, resulting in a frame rate typically below 2 fps, further
       | compounded by network bottlenecks.
       | 
       | As for model capabilities, NeuralOS is indeed quite limited at
       | this point (as acknowledged in my paper abstract). That's why the
       | demo interactions shown in my tweet were minimal (opening
       | Firefox, typing a URL).
       | 
       | Overall, this is meant as a proof-of-concept demonstrating the
       | potential of generative, neural-network-powered GUIs. It's fully
       | open-source, and I hope others can help improve it going forward!
       | 
       | Thanks again for the honest feedback.
        
         | yunyu wrote:
         | Maybe put the warning below the UI, so it doesn't cause the
         | layout to change?
        
           | yuntian wrote:
           | Good idea. I'll update when no one is using it, don't want to
           | cause further interruptions...
        
       | UncleOxidant wrote:
       | Who thought this was a good idea?
        
         | odyssey7 wrote:
         | It seems inevitable.
        
       | 273kgracia wrote:
       | You can visit NeuralOS inside NeuralOS!
        
       | jjaksic wrote:
       | This reminds me of a recent conversation we had at work where
       | someone suggested that at some point all backend APIs are going
       | to get replaced by a single LLM that'll just do anything (if you
       | ask it nicely enough).
        
       ___________________________________________________________________
       (page generated 2025-07-14 23:00 UTC)