[HN Gopher] Show HN : Nova - GPT with composable prompts, worksp...
___________________________________________________________________
Show HN : Nova - GPT with composable prompts, workspaces, +
LlamaIndex
Author : samueltates
Score : 36 points
Date : 2023-07-09 04:40 UTC (18 hours ago)
(HTM) web link (samueltate.com)
(TXT) w3m dump (samueltate.com)
| lucb1e wrote:
| Well that's ironic, I was looking for an app called "nova" six
| hours ago and told the person who recommended it that there's a
| dozen apps called nova and to clarify what they mean. I might
| recommend a different name if you want people to be able to find
| this!
| fidla wrote:
| I asked it a simple question about an address on Google maps and
| it couldn't answer
| samueltates wrote:
| Wanted to introduce NOVA - agent with dynamic management of
| prompts, functions and document access.
|
| Key features - Create and manage multiple prompts, enabling,
| disabling, removing,
|
| - Persistent memory, essentially rolling summary windows plus
| traversable index
|
| - Turn on 'auto-gpt like' functionality like write, read, query
|
| - Embed pdfs and google docs using the amazing LlamaIndex
|
| - Create new channels / configurations, and share those with
| other people
|
| Intro video here : https://www.youtube.com/watch?v=FB_g_8ofSlE
|
| You can essentially craft a set of prompts and document
| connections, interact with that agent over time, with persistent
| memory, and shared docs. You can make that public, so being able
| to share embeddings was the thinking, but also shared memory.
|
| _The stack_
|
| It's a react front end, to a python cloud server. Hope is to make
| that server client agnostic, delivered via API. So people could
| compose agents, behaviours, permissions in NOVA, and deliver
| agent behaviours into their own flows, thinking AMS (agent
| management system).
|
| Having it on a server puts all logs, convos, documents cloud
| access. My actual goal is a local app, and able to add / connect
| your own endpoints, or connect your account, but potentially sync
| with the cloud.
|
| Right now it is openAI using my key, and I've got a credit
| system, it works out to be about double the cost, but I've
| included $10USD. I'll add ability to connect your own API soon,
| as well as sliding scale for credits.
|
| _Using it_
|
| - Jumping on, you'll see a 'public' space I've made, and nova is
| configured for guests
|
| - Sign in with single sign on and it'll generate a 'new user'
| space designed to do goal setting
|
| - Both spaces were created 'with the tools' so an example of its
| utility
|
| - You can then either clear all those prompts, or make a new
| space and start fresh, creating instructions for an agent you
| might find useful (or using it to test different agents for your
| own work)
|
| I made a walkthrough of the basics here :
| https://www.youtube.com/watch?v=iQpt0B5LzNI
|
| _More advanced stuff_
|
| - So the toggles on the side are 'cartridges' (my term for json
| blob of prompts, commands, settings, all injecting at runtime)
|
| - If you add an 'index' cartridge, it directly adds an index
| using LlamaIndex - so you can add a pdf, or google doc (the auth
| flow there isn't approved so you'll get warnings) - you can query
| directly in cartridge, or agent can query if commands are on
|
| - If you add a command cartridge, it turns on 'auto-gpt-lite' -
| basically switches to json returns, switches on command parsing,
| you'll see the commands are cofigurable, but I'm going to rethink
| all that
|
| - If you add a settings cartridge, it then adds settings, main
| ones are 'give context' injects your name, date, number of convos
| (based on user account)
|
| - Most importantly you can switch between gpt-3.5-turbo and
| gpt-4, any typos will cook it, you can see here the sketch of
| configurable agents, different api sources etc
|
| Longer video talking through these features and ideas :
| https://www.youtube.com/watch?v=MM9pSd8ADuQ
|
| This has been a pretty big mission, but I'm happy with the first
| offer and excited to keep working on it, adding multi-step
| behaviours, other librarys for image rec etc. Next steps are
| improve command behaviour. Most importantly get user feedback!
|
| But as it is today, configuring the agent in the way you like,
| and giving it an easy memory overview, and playing with different
| 'types' of agent, is pretty great.
|
| New users get $10 worth of credt, can top up or donate if you
| find it useful. Any issues or thoughts catch me via
| me@samueltate.com or @samueltates on twitter.
|
| Mostly I just hope you can try it out, I've had some great
| feedback about the prompt composition and document embedding. But
| also I just like Nova - that bit of persistence, context and
| agency makes a pretty cool pal.
|
| thanks!
| ssd532 wrote:
| What does it mean that it has persistent memory?
| Der_Einzige wrote:
| Vector DB storage
| tagyro wrote:
| I got to play with Nova a bit, a couple of thoughts:
|
| - the quality of the answers is not better than gpt-3.5/4.
| Maybe I had too high expectations, but I didn't notice any
| improvements over the default answers from the "open"ai ones
| (for example, the "apple test" - write 10 sentences that end
| with the word "apple", got a 5/10 - not great)
|
| - sign in with google ...I know this is the "easy" path for
| implementation, but I imagine some people (me included) really
| don't want to login with brother g
|
| - the tone of Nova is, imo, too friendly. I know this is a LLM,
| don't need to pretend like it's my friend/counsellor
|
| I hope my feedback doesn't come of as rude, looking forward to
| the next iteration!
|
| off-topic: on your website, you still have a (c) notice with
| 2022 ;)
| swyx wrote:
| congrats on launching OP. i have to say the sidebar is very
| confusing, does too much, and had no explanation of how to use
| them. hope you get to work on the UX a bit.
|
| edit - just saw that you made more videos to explain those
| things. well put them all in one video!
| stalfosknight wrote:
| But does it start nearly every reply with "As an AI language
| model..."?
___________________________________________________________________
(page generated 2023-07-09 23:01 UTC)