Posts by gregors@mastodon.world
 (DIR) Post #AcoTGH4iqpEw3sLaEq by gregors@mastodon.world
       2023-12-14T21:44:16Z
       
       0 likes, 0 repeats
       
       @simon hey Simon, love your work! I guess you need a 64gb Mac? Would it run on a 32gb?
       
 (DIR) Post #ActWHqjY8yuw5O0Egy by gregors@mastodon.world
       2023-12-17T08:11:46Z
       
       0 likes, 0 repeats
       
       @simon works with q3 model. Of course, I had to ask a tribute to Simon question :)It's really cool to see how RAM usage ramps up when the weights get loaded.
       
 (DIR) Post #AcxYPDWulOjdM3ZcBc by gregors@mastodon.world
       2023-12-19T06:54:28Z
       
       0 likes, 0 repeats
       
       @simon you can use mixtral also via web UI over at https://labs.perplexity.aiIt's not as cool as running it locally, but if you are thin on RAM, it's one of the options ;)