https://elijahpotter.dev/articles/prompting_large_language_models_in_bash_scripts

Profile Picture

Elijah Potter

RSS Icon

Prompting Large Language Models In Bash Scripts

I've been experimenting with using LLMs locally for
generating datasets to test Harper against. I might write a blog
post about the technique (which I am grandiosely calling "
LLM-assisted fuzzing"), but I'm going to make you wait.

I've written a little tool called ofc that lets you insert Ollama
into your bash scripts. I think it's pretty neat, since it (very
easily) lets you do some pretty cool things.

For example, you can swap out the system prompt, so if you want to
compare behavior across prompts, you can just toss it in a loop:

#!/bin/bash

subreddits=("r/vscode" "r/neovim" "r/wallstreetbets")

# Loop over each item in the list
for subreddit in "${subreddits[@]}"; do
  echo "++++++++ BEGIN $subreddit ++++++++"
  ofc --system-prompt "Assume the persona of a commenter of $subreddit" "What is your opinion on pepperjack cheese."
  cat
done

Or, you can instruct a model to prompt itself:

ofc --system-prompt "$(ofc "Write a prompt for a large language model that makes it think harder. ")" "What is a while loop?"

Installation

ofc is installable from either crates.io or its repository.

cargo install ofc --locked

# Or...
cargo install --git https://github.com/elijah-potter/ofc --locked

Other Stuff

 

Why Rust May Be More Attractive than Javascript

A key part of Rust is far better that what JavaScript has to offer.

 

For the Love of Iframes

Chronically underrated, chronically over-prescribed

 

Build a Wordle Solver Using Rust

I built a Wordle solver in Rust to beat my grandma. Follow the
journey of how I did, and how I failed.