[HN Gopher] What's in your hands? 3D Reconstruction of Generic O...
       ___________________________________________________________________
        
       What's in your hands? 3D Reconstruction of Generic Objects in Hands
        
       Author : lnyan
       Score  : 24 points
       Date   : 2022-04-15 05:39 UTC (1 days ago)
        
 (HTM) web link (judyye.github.io)
 (TXT) w3m dump (judyye.github.io)
        
       | quanto wrote:
       | Instead of working from a single 2D image as this work does, what
       | is the state of the art for 3D reconstruction from multiple (non-
       | calibrated) images? e.g. some casual shots of an object using my
       | phone.
        
         | jgod wrote:
         | Photogrammetry apps, right?
        
         | mkaic wrote:
         | probably Nvidia's latest Instant Neural Graphics Primitives
         | paper (as far as I'm aware). they demonstrate near-
         | instantaneous training of NeRF models:
         | 
         | https://nvlabs.github.io/instant-ngp/
        
         | theschwa wrote:
         | It depends on the goal, but the whole family of NeRF techniques
         | have been achieving some really interesting results.
        
       | daenz wrote:
       | Dashcam threat sensors identified the suspect was holding a
       | handgun-shaped object...
       | 
       | -A press conference in the near future
        
       | hwers wrote:
       | I know even publishing the code for stuff like this is generous
       | but it'd be so cool if the standard practice included publishing
       | a little wasm binary blob as a library independent network with
       | weights to play with without having to go through colab. (Many
       | frameworks have a way of creating that automatically already,
       | e.g. torchscript or jax jit.)
        
         | quanto wrote:
         | I am not as familiar with the state of the art; are there NN
         | frameworks that export the NN model such that it can be run
         | within WASM?
        
           | hwers wrote:
           | Yup. In torch you can use torchscript and in jax you can
           | 'jit' a function and both turn your NN function into a fairly
           | easily compliable form which could then be translated to
           | wasm.
           | 
           | Here's a cool project that does something like this (though I
           | believe it's basically superseded by torchscript):
           | https://github.com/podgorskiy/tensor4 Here it is running
           | stylegan in the browser (via wasm):
           | http://podgorskiy.com/static/stylegan/stylegan.html
        
       ___________________________________________________________________
       (page generated 2022-04-16 23:01 UTC)