Opinions on Pezzo for Prompt Management and Cost Monitoring
reddit / selfhosted

----------------------------------------------------------------------
GratefullyFriendly73 · 2023-10-26 03:20

I've come across Pezzo, which claims to combine prompt management and
cost monitoring. Has anyone used it for these features? How effective
is it

[https://github.com/pezzolabs/pezzo](https://github.com/pezzolabs/pezz
o)

----------------------------------------------------------------------
Excellent-Garden-227 · 2023-10-26 03:52

We've been using for a while. Works great overall. What we like about
it is that it's truly open source which is critical for us as we need
to monitor our LLM usage but cannot afford to use SaaS products
without compliance, so we self host.\r \r Some points to note:\r - No
LangChain support yet\r - No public helm charts (but the Docker
Compose files are elaborate)\r - Infra heavy if you want to self host
(redis, elasticsearch, postgres etc)

----------------------------------------------------------------------
InfamousBacklash05 · 2023-10-26 20:16

We've been using for a while. Works great overall. What we like about
it is that it's truly open source which is critical for us as we need
to monitor our LLM usage but cannot afford to use SaaS products
without compliance, so we self host.
Some points to note:
\- No LangChain support yet
\- No public helm charts (but the Docker Compose files are elaborate)
\- Infra heavy if you want to self host (redis, elasticsearch,
postgres etc)