[HN Gopher] Show HN: I made a Mac app to search my images and vi...
___________________________________________________________________
Show HN: I made a Mac app to search my images and videos locally
with ML
Desktop Docs is a Mac app that lets you search all your photos and
videos in seconds with AI. Once you find the file you're looking
for you can resize it, export it to Adobe Premiere Pro, or drag and
drop it into another app. I built Desktop Docs because I keep tons
of media files on my computer and I can never remember where I save
stuff (lots of screenshots, memes, and downloads). The Apple Photos
app also only supports photos in your iCloud. Desktop Docs
supports adding folders or individual files to an AI Library where
you can search by the contents of your files, not just file titles.
You can search by objects ("cardboard box"), actions ("man
smiling", "car driving"), by emotion ("surprised woman", "sad
cowboy"), or the text in the frame (great for screenshots or
memes). It's also 100% private. Make any media searchable without
it ever leaving your computer. How I built it: - 100% Javascript
(I'm using Electron JS and React JS). - Embedding generation (CLIP
from OpenAI is used to compute the image embeddings and text
embeddings for user queries). - Redis (storing and doing KNN search
on the embeddings with this DB). - Image/video editing (the app
ships with FFmpeg binaries to explode videos into individual frames
and scale images). Demo:
https://www.youtube.com/watch?v=EIUgPNHOKKc If there are any
features you'd like to see in Desktop Docs or want to learn more
about how I built it, drop me a comment below. Happy to share more.
Author : correa_brian
Score : 33 points
Date : 2024-05-15 19:44 UTC (3 hours ago)
(HTM) web link (desktopdocs.com)
(TXT) w3m dump (desktopdocs.com)
| edude03 wrote:
| Some feedback - for me (and probably for the HN crowd) saying
| it's powered by "AI" takes away credibility from what otherwise
| seems like a reasonable project.
|
| My first impression was that you'd "just" upload my pictures to
| OpenAI with a prompt and call it a day.
|
| Maybe highlight that it uses ML running locally? (I see that it's
| in the FAQ, but in the title)
| correa_brian wrote:
| Thanks for the feedback and for taking a look. I think that's a
| fair point.
| frizlab wrote:
| You did not build a Mac app, you built a webpage in a shell of a
| Mac app...
| correa_brian wrote:
| Appreciate you checking it out.
| xu_ituairo wrote:
| This is an unkind nitpick of something someone has made.
|
| It's an app that runs on a Mac. What framework it's running on
| doesn't make it less of an app.
| pyinstallwoes wrote:
| well it's not a Mac app.
|
| https://developer.apple.com/design/human-interface-
| guideline...
| robotnikman wrote:
| This might be a good thing, since it means it could be more
| easily ported to Windows and Linux as well
| sgt wrote:
| If this is an offline app - or at least that your images don't
| leave your computer, that's pretty cool. How big is that model
| provided by OpenAI? Doesn't the app itself become huge?
| givinguflac wrote:
| This seems like a really neat tool, nice work! I wish I had a use
| case for it- any plans for pdf or text file support? I'd love a
| local assistant that allowed for parsing my pdfs and text files
| the same way.
| hendrikvp wrote:
| This is what Spotlight on macOS is doing for all files by
| default, just in case you didn't know?
| HKH2 wrote:
| It will only find exact matches though. No synonyms etc.
| hanniabu wrote:
| If this can be made into an Umbrel app that'd be sick!
| hanniabu wrote:
| For more context, I like the private nature of this. None of
| Umbrel apps have object recognition so it requires you to
| tediously add metadata tags, which becomes more of a chore and
| something you don't actually do, leaving your photos to "rot".
| jbaber wrote:
| This honestly sounds great and the price looks great, too.
|
| Only things stopping me are
|
| 1. I'm on regular Linux 2. It's not clear if it sends absolutely
| nothing out over the network.
|
| 1. Might be a heavy lift depending on your UI library or a
| trivial thing if you can expose everything as CLI executables. 2.
| Sounds like that's the intent, I just want to be really sure.
| hendrikvp wrote:
| Interesting. How long does it take to build the index of a movie
| like spider man (on whatever hardware you have at hand)? And how
| big will its index be?
| thealistra wrote:
| Just a legal question. Can it really be non refundable? Aren't
| there markets where regulators would require for you to refund?
| jshchnz wrote:
| or could just use Screenie (100% free & local):
| https://apps.apple.com/us/app/screenie-screenshot-manager/id...
| atentaten wrote:
| Does Screenie search frames inside of videos?
| jonathankoren wrote:
| Oh my god! A locally run one time purchase application!
|
| I'm so glad someone remembers how software is supposed to work.
|
| Thanks.
| blacksmith_tb wrote:
| Not sure how much low-level filesystem access you'd need, but it
| would be cool to support adding metadata via tags, a la
|
| https://github.com/jdberry/tag/
___________________________________________________________________
(page generated 2024-05-15 23:00 UTC)