Bananalyzer 🍌: Open source and fully local web environments for web
task testing
reddit / selfhosted

----------------------------------------------------------------------
Pi_ofthe_Beholder · 2023-11-28 05:25

That name is spectacular

----------------------------------------------------------------------
crysisnotaverted · 2023-11-28 06:04

I might be too dumb for this one, boys. I can't wrap my head around
what "Open source AI Agent evaluations for web tasks" means...

Other than me being stupid, that is one well designed github repo,
lol.

----------------------------------------------------------------------
coff33ninja · 2023-11-28 06:09

Love the naming and idea for this repo, star and upvote. I want to
follow where this package is going.

----------------------------------------------------------------------
nashosted · 2023-11-28 13:55

Aren't you the same dev who create AgentGPT? Brilliant project btw!

----------------------------------------------------------------------
isleepbad · 2023-11-28 17:05

I was hoping bans were being analyzed. Would have been a great
pun/aptronym.

----------------------------------------------------------------------
asim-shrestha · 2023-11-28 20:20

😂 a bit opaque if you're not super familiar with the space i suppose

​

ELI5: Theres a lot of work being done with LLMs to take actions on
websites. This open source repo provides static versions of these
websites along with some evaluation criteria to measure the
performance of your LLM "agents". Its quite a pain to reliably test
these agents otherwise. (An agent being some system of code that will
take a goal like "travel to xyz on this page" and use an llm to
translate that into actual actions)

----------------------------------------------------------------------
asim-shrestha · 2023-11-28 20:21

Yes haha, appreciate it!

----------------------------------------------------------------------
asim-shrestha · 2023-11-28 20:21

We at some point decided to theme all of our projects after monkeys.
Glad you two like it :)

----------------------------------------------------------------------
crysisnotaverted · 2023-11-28 20:21

Oh my God, thank you lol. That makes sense.

----------------------------------------------------------------------
asim-shrestha · 2023-11-28 20:22

Appreciate it! Have a lot of cool plans for this project :)