[HN Gopher] Show HN: Gdansk AI - full stack AI voice chatbot
___________________________________________________________________
Show HN: Gdansk AI - full stack AI voice chatbot
Hi! It's a complete product with integrations to Auth0, OpenAI,
Google Cloud and Stripe, which consists of Next.js Web App, Node.js
+ Express Web API and Python + FastAPI AI API I've built this
software, because I wanted to make money by selling tokens to
enable users talking with the chatbot. But I think Google / Apple
will include such AI-powered assistant in their products soon, so
nobody will pay me for using it So I open source the product today
and share it as a GNU GPL-2 licensed software I'm happy to assist
in case if something is unclear or requires additional docs and
answer any questions about Gdansk AI :) Thanks
Author : yu3zhou4
Score : 77 points
Date : 2023-08-04 19:29 UTC (3 hours ago)
(HTM) web link (github.com)
(TXT) w3m dump (github.com)
| hidelooktropic wrote:
| Nice work. I noticed the bing app does this too and I'm curious
| how this would compare
| a2128 wrote:
| I've always wondered if there's a better way of making voice
| assistants. With this stack, the AI will not be able to answer
| "what is this sound?", or give you UK-based information because
| it picked up on your British accent. It's bottlenecked by text. A
| model that can understand audio as input, and output audio
| directly, could be so much more powerful
| og_kalu wrote:
| Sure there's a better way. https://google-
| research.github.io/seanet/audiopalm/examples/
|
| There's no reason autoregressive LMs can't be used to model
| audio data.
| ramesh31 wrote:
| I've honestly lost all interest in anything integrating with
| OpenAI at this point. Llama 2 is giving completions at ChatGPT
| levels with a single GPU. I've replaced all of my LLM usage with
| it.
|
| Open local models are the future.
| Jeff_Brown wrote:
| Open local models are literally the past, but the very recent
| past. I therefore agree -- as long as they remain only on the
| order of a year older than the cutting edge, their future looks
| extremely bright.
|
| I just hope for-profit enterprises continue wanting to push
| that frontier as hard as they have been. (Wait, actually also
| if they stop doing that it might be for the best ...)
| ramesh31 wrote:
| >Open local models are literally the past, but the very
| recent past. I therefore agree -- as long as they remain only
| on the order of a year older than the cutting edge, their
| future looks extremely bright.
|
| I think the qualitative difference between Llama 2 and _any_
| previous open LLM is sufficient to the point that we can call
| this a new epoch. It took OpenAI spending millions on free
| compute to show the world what these things are capable of.
| And because it 's something you can really only believe when
| you see it, that's what set things off.
|
| But the cat's out of the bag now, and it's never going back.
| I think OpenAI would do well to return to their roots of pure
| research rather than bothering with the product side of
| things. Come up with the latest and greatest new models, then
| chuck 'em over the fence for Microsoft to monetize.
|
| >I just hope for-profit enterprises continue wanting to push
| that frontier as hard as they have been. (Wait, actually also
| if they stop doing that it might be for the best ...)
|
| My bet is that Meta is pivoting hard right now. Llama is
| probably their most successful project/product/whatever since
| Instagram. They have the talent, the money, and (crucially
| right now) the hardware to do it. And this plays directly
| into Zuck's desire for a platform. It seems pretty obvious
| their play is to build an ecosystem around these things and
| start gradually introducing licensing fees (and/or hosted
| models) for big commercial users.
| starik36 wrote:
| Which GPU is capable of all that? And which do you have a write
| up for this?
| aka878 wrote:
| Swietne imie
| renegat0x0 wrote:
| Polacy nie gesi
| scyzoryk_xyz wrote:
| Tylko takie troche malo ,,miedzynarodowe"
| tomwojcik wrote:
| There's a few. Off the top of my head
|
| https://github.com/kopia/kopia
| yu3zhou4 wrote:
| Sa tez nazwy nieintencjonalnie polskie. Gdy pierwszy raz
| uslyszalem nazwe Zapier, pomyslalem, ze zalozycielem jest
| Polak :p
| yu3zhou4 wrote:
| To prawda. Sprobujmy umiedzynarodowic polskie nazwy :)
| kjok wrote:
| Great job on Gdansk AI! How do you handle the speech-text/API
| latency?
|
| Coincidentally, I'm working on an idea that is similar to your
| other project https://poss.market/market/ How's it going? Would
| love to learn more.
| yu3zhou4 wrote:
| Hi, thanks! STT/TTS latencies are a bit bottleneck here
| unfortunately, so it's not as fast as I'd want to
|
| I'm about to launch poss market on production! Feel free to
| drop a mail at jed@maczan.pl
| selestify wrote:
| Out of curiosity, why GPL2 instead of 3?
| yu3zhou4 wrote:
| No good reason behind it, I'm just not very familiar with GPL3
| so I often default to 2. What could be reasons to pick 3 over
| 2? I can consider it
| benreesman wrote:
| Related, what's the current SOTA on STT models freely available?
| T5 is pretty good but the closed Google and Meta stuff seems
| better.
| nielsinho wrote:
| TorToiSe (https://github.com/neonbjb/tortoise-tts) produces the
| best quality speech of any freely available model. However, its
| long inference times makes it impractical for voice chatbots
| like Gdansk.
| kjok wrote:
| What's the reason for the high inference latency? Any ideas
| on how this could be improved?
| julianeon wrote:
| I've thought that AI voice (anything) is probably the most useful
| area of AI that's not been built yet in a form that's generally
| known and available.
|
| So kudos to you for building something useful and, as YC says,
| for 'building something people want.'
| quantum-crt wrote:
| Looks cool! Do you have a hosted version anywhere we could play
| around with?
| yu3zhou4 wrote:
| Demo is live! https://bibop.app/
|
| Let me know if there are any troubles running it. It works
| under Google Chrome
| yu3zhou4 wrote:
| I'm setting up the project on DigitalOcean right now!
___________________________________________________________________
(page generated 2023-08-04 23:01 UTC)