[HN Gopher] Show HN: Grammar Generator App for Llama.cpp
___________________________________________________________________
Show HN: Grammar Generator App for Llama.cpp
llama.cpp added context-free grammar guided generation
functionality. It requires passing a file in a derivative of BNF
notation, which gets messy very quickly for things like JSON. To
improve the experience, we built a small compiler from TypeScript
interfaces to the grammar file format and have it hosted in a
little browser app. See more in discussion at
https://github.com/ggerganov/llama.cpp/discussions/2494
Author : aduffy
Score : 6 points
Date : 2023-08-02 20:39 UTC (2 hours ago)
(HTM) web link (grammar.intrinsiclabs.ai)
(TXT) w3m dump (grammar.intrinsiclabs.ai)
| idkyall wrote:
| Small Nit: "This grammer can be used during LLMs generation."
|
| I didn't know Llama.cpp had this grammar feature, so this is
| interesting.
| dataf3l wrote:
| Can you add examples on how to use this because I have honestly
| no idea how to use it
___________________________________________________________________
(page generated 2023-08-02 23:01 UTC)