Post ATgTIQyATHOb2PI1vk by numist@xoxo.zone
 (DIR) More posts by numist@xoxo.zone
 (DIR) Post #ATgQnyPfsXudsNVGgS by jesse@metasocial.com
       2023-03-16T18:39:08Z
       
       0 likes, 0 repeats
       
       @simon has anyone ported LLaMA to Apple’s CoreML yet?
       
 (DIR) Post #ATgQnz4RQyWRuoZpE8 by simon@fedi.simonwillison.net
       2023-03-16T19:50:06Z
       
       0 likes, 0 repeats
       
       @jesse Not that I've seen - but the Python original LLaMA version uses Torch and Torch 2.0 has a "Metal Performance Shaders" backend which uses the GPU on Mac https://pytorch.org/blog/pytorch-2.0-release/
       
 (DIR) Post #ATgTIQyATHOb2PI1vk by numist@xoxo.zone
       2023-03-16T20:16:58Z
       
       0 likes, 0 repeats
       
       @simon @jesse So much silicon getting left on the table; the dream of OpenCL lives on.