Posts by ajs@toot.community
 (DIR) Post #ASNQtP3IoQTvfLgaaO by ajs@toot.community
       2023-02-05T17:59:07Z
       
       0 likes, 0 repeats
       
       @simon I don’t think anyone serious uses LLMs directly as a search engine. Rather the intriguing bit is using the language embeddings (a byproduct of building the LLM) to implement semantic search. That’s why the OpenAI embedding API is so interesting.
       
 (DIR) Post #ASNWvijvBYlZ1t6oSG by ajs@toot.community
       2023-02-05T19:07:06Z
       
       0 likes, 0 repeats
       
       @simon I agree; it takes a bit to realise that although everything it generates seems reasonable, it can’t reason. That said, what still amazes me is that if you point out flaws it can often self-correct. ML colleagues mumble about attention mechanisms being in use as if this is completely obvious.Maybe a parallel to draw about people trusting it unreasonably is that of social media as a good news source: a lot of people can’t distinguish between the two. (And confusingly, sometimes it is!)
       
 (DIR) Post #AcAG6s3CYecBW5BQae by ajs@toot.community
       2023-11-25T12:08:16Z
       
       0 likes, 0 repeats
       
       @simon I know folk that were in the process of setting up to spend 6–7 figures annually with them, and now legal and procurement are going to be… much harder to convince than before. They prefer dealing with adults.
       
 (DIR) Post #AdVvfP9oUQSfTQEYm8 by ajs@toot.community
       2024-01-04T20:54:56Z
       
       0 likes, 0 repeats
       
       @simon I’ve set OIDC up with AWS and GCP and it’s intimidating at first sight. But also totally worth it when you realise you don’t need to manage and worry about the tokens/secrets any more. The actions just implicitly run as the service account, just as if you’re using workload identity in a VM or CloudRun action or whatever. Totally worth it.