Posts by hruske@mastodon.green
 (DIR) Post #AXef3fYpWOUPfzxc1I by hruske@mastodon.green
       2023-07-13T14:48:25Z
       
       0 likes, 0 repeats
       
       @simon Debian Bookworm release notes recommend using pipx to install non-Debian provided Python based tools.https://www.debian.org/releases/bookworm/amd64/release-notes/ch-information.en.html#python3-pep-668
       
 (DIR) Post #AZEBj5Cf5XSoOBUGUy by hruske@mastodon.green
       2023-08-29T16:01:03Z
       
       0 likes, 0 repeats
       
       @simon I've tried this tutorial just now, and the models failed to load until I didpip install --force-reinstall --ignore-installed --no-cache-dir llama-cpp-python==0.1.65After trying different versions, this worked. Hint for this I found here - https://github.com/abetlen/llama-cpp-python/issues/204