Post AdTZR2biwitIAt7Aem by oatmeal@emacs.ch
 (DIR) More posts by oatmeal@emacs.ch
 (DIR) Post #AdTMnxcOMaGpxP1ed6 by oatmeal@emacs.ch
       2024-01-03T15:16:49Z
       
       0 likes, 0 repeats
       
       #emacs Trying to install rocm on Fedora 39 was really messy... containerized ollama with# rocm support was relatively easy to get running. Used this recipe from https://github.com/prawilny/ollama-rocm-docker/tree/master... only had to point at another repo for rocm itself, since the one used there does not exist anymore. Was able to pull models in, but it crashes on running any prompt.```RUN git clone --recursive https://github.com/jmorganca/ollama.git ollama-rocm && \``` #ellama #amdgpu #llm #docker #podman
       
 (DIR) Post #AdTQ6wtrYci95twYoS by harish@hachyderm.io
       2024-01-03T15:53:52Z
       
       0 likes, 0 repeats
       
       @oatmeal It’s so difficult and unpolished. (The AMD software stack in mean.)Could you clarify what you mean by “another repo for rock itself?” I tried on Debian and crashed and burned so hard.
       
 (DIR) Post #AdTZR2biwitIAt7Aem by oatmeal@emacs.ch
       2024-01-03T17:38:23Z
       
       0 likes, 0 repeats
       
       @harish yes, saw a lot of complaints... What I meant was that the original Dockerfile from that repo pull ollama with rocm enabled from a repo that's no longer available. So I pointed it instead to the one I was already using. https://github.com/jmorganca/ollama.gitNote that the `go build` command enables rocm support with "-tags rocm"I think the crash is due to the onboard graphic being also active. I saw a comment somewhere it should be disabled, but my BIOS setup doesn't seem to allow disabling it.