Post AWvvTG9uIy1BuuZf72 by jjtech@infosec.exchange
(DIR) More posts by jjtech@infosec.exchange
(DIR) Post #AWvufG8I7ylBMBybCq by zhuowei@notnow.dev
2023-06-22T00:43:28.756356Z
0 likes, 0 repeats
Clear my calendar: we're doing visionOS simulator shenanigans!
(DIR) Post #AWvvTG9uIy1BuuZf72 by jjtech@infosec.exchange
2023-06-22T00:50:37Z
0 likes, 0 repeats
@zhuowei Do you think it would be possible to plug in 3DOF tracking into the simulator? and perhaps get it to output in 3D SBS?
(DIR) Post #AWvvTGzJDr8QUKciES by zhuowei@notnow.dev
2023-06-22T00:52:29.981905Z
0 likes, 0 repeats
@jjtech @ShinyQuagsire is trying to hook it up to a Meta Quest. https://twitter.com/ShinyQuagsire/status/1671625079375945729I'll look into it too: I bought a PSVR1 last week specifically to see if it's possible to get 3DOF support (hence the simpler headset)
(DIR) Post #AWvx3lIE7sLUrCR2Rc by zhuowei@notnow.dev
2023-06-22T01:10:16.844523Z
0 likes, 0 repeats
`LC_ALL=C grep -r berration .` shows that there's a `./usr/lib/libDisplayWarpSupport.dylib` used by `./usr/libexec/wakeboardd`; does that have anything to do with the headset params
(DIR) Post #AWvx990NOOWXqYeUzY by jjtech@infosec.exchange
2023-06-22T00:54:21Z
1 likes, 0 repeats
@zhuowei @ShinyQuagsire I only have a #NrealAir, but it would be especially cool if the background was just black, since then the transparent OLED would pass through without the fancy cameras (though obviously worse, but also $3000 cheaper)
(DIR) Post #AWvxFj7a1giFb3A0rg by saagar@federated.saagarjha.com
2023-06-22T01:07:01.688697Z
0 likes, 0 repeats
@zhuowei [insert Elsa GIF here]
(DIR) Post #AWvxFjpBPZahmHYppQ by zhuowei@notnow.dev
2023-06-22T01:12:28.004411Z
0 likes, 0 repeats
@saagar https://twitter.com/zhuowei/status/1569118376491876352
(DIR) Post #AWvxeydFUiwMwT0u0G by zhuowei@notnow.dev
2023-06-22T01:17:01.910244Z
0 likes, 0 repeats
Stupid questions I need the answers to:- Has any dataminer found the cursed EyeSight front display code in the simulator yet?- Does the simulator have the Persona FaceTime avatars?- Are the "Memories" 3D photos just stereo photos / videos?
(DIR) Post #AWvxouOK7H1AgYlgGG by saagar@federated.saagarjha.com
2023-06-22T01:17:41.185254Z
1 likes, 0 repeats
@zhuowei It’s a tough crowd out there, huh
(DIR) Post #AWvzPgKVSYjpk856XI by zhuowei@notnow.dev
2023-06-22T01:36:40.909788Z
0 likes, 0 repeats
"Simulated Senes"... You had two and a half weeks and you didn't catch this spelling mistake?
(DIR) Post #AWw0U1oVcnbtUEkdpQ by zhuowei@notnow.dev
2023-06-22T01:48:37.648441Z
0 likes, 0 repeats
Huh, if I suspend wakeboardd, the simulator still draws fine. So maybe that's not what's rendering the screen.
(DIR) Post #AWw0iLGW6I3Nrxg288 by zhuowei@notnow.dev
2023-06-22T01:51:15.791451Z
0 likes, 0 repeats
All right, if I suspend wakeboardd, the screen stops drawing. So I think that's promising - the binary that mentions warping really does seem to be involved in rendering the output
(DIR) Post #AWw1I6DJXVnJc2EHR2 by zhuowei@notnow.dev
2023-06-22T01:57:43.177327Z
0 likes, 0 repeats
It looks like wakeboardd does do stuff with IOSurfaces:* thread #3, name = 'compositor-rt-thread', stop reason = breakpoint 8.1 * frame #0: 0x0000000100ba4b74 wakeboardd`rt_sim_display_submit_surface frame #1: 0x0000000100b960b0 wakeboardd`rt_sim_hmd_composite + 1640 frame #2: 0x0000000100bb6484 wakeboardd`rt_thread_main + 896 frame #3: 0x0000000106cef4c0 libsystem_pthread.dylib`_pthread_start + 104rt_sim_display_submit_surface(something, IOSurface*)... still not sure if this is the right binary though. Ghidra time?
(DIR) Post #AWw2EnWcfOTAjiFaFc by zhuowei@notnow.dev
2023-06-22T02:08:19.917377Z
0 likes, 0 repeats
rt_sim_hmd_composite does some Metal rendering of an IOSurface.
(DIR) Post #AWw2iyXiGg3bau9ND6 by zhuowei@notnow.dev
2023-06-22T02:13:46.931121Z
0 likes, 0 repeats
1) looks like RealityEnvironment draws the simulator environment:xcrun simctl spawn booted defaults readgives "com.apple.RealityEnvironment" = { activeSyntheticEnvironment = LivingRoomDay; };2) wakeboardd has a bunch of defaults that it reads beginning with hmd.
(DIR) Post #AWw6g8EoAIVcbwCu24 by zhuowei@notnow.dev
2023-06-22T02:58:04.750622Z
0 likes, 0 repeats
Did Apple seriously not build themselves a 3d stereo view for the simulator?
(DIR) Post #AWwA8ZoHXtXc5y3SdM by jason@logoff.website
2023-06-22T03:21:47Z
0 likes, 0 repeats
@zhuowei with like… what? Crossing your eyes?
(DIR) Post #AWwA8alTzmtd3ZkjuS by zhuowei@notnow.dev
2023-06-22T03:36:50.206759Z
0 likes, 0 repeats
@jason "The Information" reported that Apple originally prototyped with HTC Vives (https://www.theinformation.com/articles/the-inside-story-of-why-apple-bet-big-on-a-mixed-reality-headset); I guess none of that code survives today
(DIR) Post #AWy429ughmbqdEWliS by zhuowei@notnow.dev
2023-06-23T01:37:49.398699Z
0 likes, 0 repeats
rt_sim_hmd_composite has a fast path where - if there's only one layer, and it's the exact same size and format as the screen - it just sends that layer directly to the (simulator's) screen. If there are multiple fully immersive layers (the composer supports up to 5) or the format doesn't match, then the compositor calls out to Metal.
(DIR) Post #AWy8d8CIRoi9qCeJ60 by zhuowei@notnow.dev
2023-06-23T02:29:22.364892Z
0 likes, 0 repeats
If you change the last "1" in the call to rt_hmd_fill_descriptor_destination / rt_hmd_fill_descriptor_layers to "2", you do get the color and depth textures for the right eye in addition to the left eye (which you get with "1"). The renderer doesn't ever try to access it, though, of course.
(DIR) Post #AWyAaOOdxleT7aFK6K by zhuowei@notnow.dev
2023-06-23T02:51:13.777671Z
0 likes, 0 repeats
Disappointingly, dumping out the second texture shows that the right eye view is completely blank (solid black colour). What else do I need to tweak before apps'd render to the right eye?