[HN Gopher] Show HN: GPULlama3.java Llama Compilied to PTX/OpenC...
___________________________________________________________________
Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now
Integrated in Quarkus
wget https://github.com/beehive-
lab/TornadoVM/releases/download/v... unzip tornadovm-2.1.0-opencl-
linux-amd64.zip # Replace <path-to-sdk> manually with the absolute
path of the extracted folder export TORNADO_SDK="<path-to-
sdk>/tornadovm-2.1.0-opencl" export PATH=$TORNADO_SDK/bin:$PATH
tornado --devices tornado --version # Navigate to the project
directory cd GPULlama3.java # Source the project-specific
environment paths -> this will ensure the source set_paths # Build
the project using Maven (skip tests for faster build) # mvn clean
package -DskipTests or just make make # Run the model (make sure
you have downloaded the model file first - see below) ./llama-
tornado --gpu --verbose-init --opencl --model beehive-
llama-3.2-1b-instruct-fp16.gguf --prompt "tell me a joke"
Author : mikepapadim
Score : 20 points
Date : 2025-12-11 15:59 UTC (7 hours ago)
| mikepapadim wrote:
| https://github.com/beehive-lab/GPULlama3.java
___________________________________________________________________
(page generated 2025-12-11 23:01 UTC)