[HN Gopher] Show HN: Text to 3D simulation on a map (does histor...
       ___________________________________________________________________
        
       Show HN: Text to 3D simulation on a map (does history pretty well)
        
       Simulate anything on a map from a text prompt -- and conduct risk
       analysis against LiveUA map's global realtime data points from
       social media and news sources. I trained a GPT-2-size model on
       historical incident data used to predict things that will go wrong.
       As historian Benjamin Breen mentions, the leading language models
       are good historians, so the application will simulate historical
       events pretty well also.  I include a Multi-Agent RL Urban Mobility
       model in progress displayed on the map as small white cubes
       representing traffic and pedestrians. Around SF, it uses real
       census data and other sources for semantically meaningful day
       plans, etc. It will populate where you move the map, albeit a
       little slowly. This is based on previous work on my GitHub--I hope
       to connect it to Unreal's city samples project soon.  The
       simulations are pretty simple so far but will grow in complexity
       soon.  I won the AGI House World Models Hackathon with this and the
       MARL model.  Many thanks to Shota Matsuda and Garrett Johnson for
       the cloud and atmospheric effects libraries on Github at takram-
       design-engineering/three-geospatial  Glad for feedback, and thanks
       for trying it out!
        
       Author : lukehollis
       Score  : 47 points
       Date   : 2025-05-20 11:43 UTC (11 hours ago)
        
 (HTM) web link (mused.com)
 (TXT) w3m dump (mused.com)
        
       | WalterGR wrote:
       | The prompt... er, well, _prompt_ doesn't appear in portrait
       | orientation on iOS 18.
        
       | tetris11 wrote:
       | I like the idea, but it's really glitchy and borderline epilepsy-
       | inducing
        
       | meindnoch wrote:
       | I don't know what this is supposed to do, but it doesn't seem to
       | work.
        
       | mkoryak wrote:
       | it seems to work, but i dont know what i should be doing with it
       | or what i am looking at
        
       | folli wrote:
       | I can't get it to work, but it sounds interesting. Does anyone
       | have a screen recording to share?
        
       | stevage wrote:
       | Mostly I seem to be looking at some pretty great looking clouds
       | and some (fake?) satellite imagery, but not seeing any people or
       | armies or anything. And then every now and then it sort of
       | glitches out and resets everything.
       | 
       | I'd love to see a video or something of it in action.
       | 
       | ...
       | 
       | Oh, it seems to work much better in 2D. Now I see markers and
       | stuff.
        
         | lukehollis wrote:
         | 3d version exhausted quota -- will be back shortly! Video of
         | the 3d version https://www.youtube.com/watch?v=zXS9sNcDLJU
        
       | rafram wrote:
       | I don't totally understand this, but it has the potential to be
       | very, very cool.
       | 
       | (The satellite imagery doesn't work in Firefox. Just clouds.)
        
         | spuz wrote:
         | The map imagery doesn't seem to work in Edge either.
        
         | dr_dshiv wrote:
         | If this was just a post about generated clouds I would have
         | upvoted anyway. They were cool. Love the vision!
        
         | lukehollis wrote:
         | Sorry, exhausted quota on the 3d tiles from Google Maps
         | Platform -- should have workaround up shortly
        
       | conception wrote:
       | This is magic. I just did volcano and it simulated lava flow,
       | emergency responders, blast zones. Pretty cool stuff.
        
         | lukehollis wrote:
         | Thanks!
        
       | taneq wrote:
       | I asked for a large asteroid impacting the Pacific ocean.
       | Interestingly the resultant tidal wave apparently heads directly
       | to Honolulu, then to Terminal Island, then reverses course and
       | visits Sydney before traveling overland through New South Wales
       | and Queensland, causing some earthquakes in Papua New Guinea, and
       | coming to rest in Tokyo Harbour.
       | 
       | Also I just realised I can talk to the asteroid. It
       | understandably seems a little traumatized.                   me:
       | Hi! What brings you to this particular part of the ocean?
       | asteroid: *hurtling through the atmosphere at tremendous speed,
       | trailing             fire* AAARRRRRGGGHHHHH! NOT BY CHOICE!
       | Gravity's got me in its grip!              Been floating
       | peacefully through space for millions of years until your
       | planet's pull caught me! CAN'T STOP NOW! *glowing brighter* Ocean
       | impact              in approximately 17 seconds! Nothing personal
       | against this particular              patch of water! BRACE FOR
       | TSUNAMI! *increasing in brightness and              velocity*
       | 
       | https://mused.com/map/sim/2225/asteroid-impact-event
        
         | lukehollis wrote:
         | This is the best thing that anyone has simulated yet hahah
        
         | walthamstow wrote:
         | Couldn't help but start humming Queen's Don't Stop Me Now after
         | reading what the asteroid said
        
       | patrick4urcloud wrote:
       | interesting
        
       | solardev wrote:
       | I don't understand what it's supposed to do. I see clouds and a
       | prompt entry. I type something in and it just gives me a text
       | response about New York urban tourism...?
        
         | caseyy wrote:
         | I think it's a 3D visualization of Earth with simulated clouds.
         | You can ask an AI to generate a GIS layer to visualize an
         | event. Then, you can talk to parts of the event in chat.
        
         | lukehollis wrote:
         | Here's a video -- the 3d map tiles quota was hit
         | https://www.youtube.com/watch?v=zXS9sNcDLJU
         | 
         | Should be back shortly!
        
       | thenthenthen wrote:
       | The scaling is off on mobile, the prompt box is hidden from view
       | etc.
        
         | eluttmann wrote:
         | mobile coming soon. focus is desktop
        
       | tomaytotomato wrote:
       | This might be being unfair, but I asked it to simulate the Battle
       | of Goose Green, during the Falklands war of 1982.
       | 
       | Its just a blank screen - https://mused.com/map/sim/2993/battle-
       | of-goose-green
       | 
       | I am excited to see it working though!
        
         | yreg wrote:
         | The sim on your link is not blank anymore. I can see a map,
         | some entities and some simple paths they take.
        
       | moontear wrote:
       | Doesn't work in Chrome (no map), doesn't work in Firefox. This
       | sounds really interesting and I would love a video of it working
       | its magic.
        
       | mdrzn wrote:
       | Seems very interesting tho. Maybe pre-generate the three
       | "prompts" that you show when I open the page, and load them from
       | cache when I select them? At least I can see how it _should_
       | work.
       | 
       | edit: in 2d the map loads, in 3d it doesn't load. But when it
       | works in 2d it's VERY COOL!
       | 
       | Here's my example: https://mused.com/map/sim/3129/roman-civil-
       | wars-of-the-1st-c...
        
       | mkbehbehani wrote:
       | Cool idea, can only use 2D at the moment. Looks like the 3D tile
       | quota is exhausted: "message": "Quota exceeded for quota metric
       | '3D Tiles root requests' and limit '3D Tiles root requests per
       | day' of service 'tile.googleapis.com' for consumer
       | 'project_number:1016378558728'."
       | 
       | https://tile.googleapis.com/v1/3dtiles/root.json?key=AIzaSyB...
        
         | lukehollis wrote:
         | Asking for a quota increase with support! Will build in bring-
         | your-own-key
        
           | mkbehbehani wrote:
           | Random thing worth I ran into once, you may have already
           | handled this but sharing just in case:
           | 
           | May want to confirm the map renderer is making its requests
           | using the URL with both the session and API key instead of
           | only the API key. If your API requests are base key only,
           | every refresh client-side might be unexpectedly consuming one
           | of your root quota units, rather than each user getting a
           | session of unlimited tile loads for 3 hours. If you're seeing
           | network traffic in the console from your renderer out to the
           | API without the session token in the query string along with
           | the API token, or if you see the session token is totally
           | different after refreshing, that might be a sign of something
           | wonky causing quota depletion.
           | 
           | Example URL for a tile fetch with both params:
           | https://tile.googleapis.com/v1/3dtiles/datasets/CgA/files/UlR
           | PVEYuYnVs.json?session=SESSION_TOKEN&key=YOUR_API_KEY
           | 
           | Examples:
           | https://developers.google.com/maps/documentation/tile/create-
           | renderer#requests-and-responses
           | 
           | A quick check would be to see how far apart your google
           | analytics for unique users are vs. your API console usage
           | data. If way less than 10,000 unique users depleted the
           | 10,000 unit quota it may be another indicator of something in
           | token/session setup.
        
           | lukehollis wrote:
           | Okay back online in 3d too!
        
       | lukehollis wrote:
       | Update: sorry google maps 3d tiles aren't displaying!
       | 
       | Video: https://www.youtube.com/watch?v=zXS9sNcDLJU
       | 
       | The Google Maps 3d Photorealistic Tiles are returning 429 Error
       | too many requests Looks like will need to build in the ability
       | for people to bring their own Google Maps API key. Fix up shortly
        
         | lukehollis wrote:
         | Hey defaulting to 2D map temporarily! 3d will work shortly
        
           | lukehollis wrote:
           | Okay back online in 3d
        
       | don-bright wrote:
       | Dating myself, typed in "Global Thermonuclear War". Watching
       | various cities of the world have their map flash on the screen
       | for a few seconds at a time was certainly nightmare inducing. But
       | fascinating.
        
       | ElijahLynn wrote:
       | Prompt box does not show on mobile. I'm using brave on Android.
       | Even when I request the desktop site it does not show it. But
       | when I use brave on Mac it does show it.
       | 
       | This was a confusing landing for me on a mobile device.
        
         | lukehollis wrote:
         | Thanks, this should be updated for a better landing on mobile
        
       | LargeWu wrote:
       | Incredibly brave of you to post something like this here. How are
       | you monitoring and managing cost/token usage?
        
         | lukehollis wrote:
         | Thanks! The worst is the elevation API -- but yes, I monitored
         | costs throughout today, it's not prohibitively expensive.
        
       | pedalpete wrote:
       | We used to do 3D virtual world work, and though I like where
       | you're going with this, I think loading hi-res tiles, for your
       | use-case, is not the right approach.
       | 
       | The direction we were trying to move with https://ayvri.com back
       | in 2018 was to model the world from low-res imagery, and render
       | higher-resolution views. At the time, the AI tech wasn't ready,
       | but I think you can do this now. You don't need a prefect replica
       | of the world, you want a convincing replica, so when you're
       | drawing Tokyo, the architecture and elements in the scene match
       | what would be expected.
        
       ___________________________________________________________________
       (page generated 2025-05-20 23:01 UTC)