Post Ab8hw2sCeR0bdzPfSi by simon@fedi.simonwillison.net
(DIR) More posts by simon@fedi.simonwillison.net
(DIR) Post #Ab6lmU82TLp0mPb4bI by simon@fedi.simonwillison.net
2023-10-24T21:52:18Z
0 likes, 0 repeats
New release of llm-gpt4all - it's now really easy to run models like mistral-7b-instruct-v0 on your own machine:pip install llmllm install llm-gpt4allllm -m mistral-7b-instruct-v0 "ten facts about pelicans"https://github.com/simonw/llm-gpt4all/releases/tag/0.2
(DIR) Post #Ab6m5BP8JT9YD3Vaee by simon@fedi.simonwillison.net
2023-10-24T21:55:56Z
0 likes, 0 repeats
If you've installed a previous version of the plugin you can upgrade it like this:llm install -U llm-gpt4allMore about the underlying GPTAll project here https://gpt4all.io/index.html
(DIR) Post #Ab6nHEHlWi9SZgN23s by mnot@techpolicy.social
2023-10-24T22:09:04Z
0 likes, 0 repeats
@simon *whispers* you should be recommending pipx...
(DIR) Post #Ab6nSmRmr3bPi6Z95U by simon@fedi.simonwillison.net
2023-10-24T22:10:35Z
0 likes, 0 repeats
@mnot yeah I should! I do in the README, but I never feel I have room for the extra link to https://pypa.github.io/pipx/ in a tootpipx is the main reason I suggest the "llm install" command for plugins, since it ensures they end up in the right virtual environment no matter how you installed it
(DIR) Post #Ab7bRRsMqeQLKPYbXk by mnot@techpolicy.social
2023-10-25T07:31:08Z
0 likes, 0 repeats
@simon I thought it came with python bow, but maybe that’s just the package I use.
(DIR) Post #Ab8cObgyBp5y13OXFA by jotkailay@mastodon.gamedev.place
2023-10-25T19:16:13Z
0 likes, 0 repeats
@simon Thanks! Is there an image processing equivalent. One where I can run queries against a photo or compare two photos? I did look at the models on the LLM site
(DIR) Post #Ab8hw2sCeR0bdzPfSi by simon@fedi.simonwillison.net
2023-10-25T20:18:37Z
0 likes, 0 repeats
@jotkailay I have not got LLaVA working through LLM yet but that's an open model that can to images as well as text - you can play with that one online here https://llava-vl.github.io