[HN Gopher] Show HN: NotesOllama - I added local LLM support to ...
___________________________________________________________________
Show HN: NotesOllama - I added local LLM support to Apple Notes
(through Ollama)
This lets you talk to local LLMs in Apple Notes. I saw Obsidian
Ollama (https://github.com/hinterdupfinger/obsidian-ollama) and
thought it was handy, but I'm too lazy to migrate away from the
Apple ecosystem, so I quickly hacked this together. I tend to use
Notes as a scratchpad for prompts, so it's nice to do some quick
inference without leaving the app. Notes doesn't really support
plugins so I'm using the macOS accessibility API for reading
selections and then stream responses using the clipboard (not ideal
but it works).
Author : rexec
Score : 96 points
Date : 2024-02-21 16:46 UTC (6 hours ago)
(HTM) web link (smallest.app)
(TXT) w3m dump (smallest.app)
| aaronbrethorst wrote:
| this looks cool. I have a request: I've been using the Notes app
| for my todo lists since mid-2020. I have one note per day, and I
| then break them up by quarter and year. e.g.:
| 2024 Q1 Monday, January 1, 2024:
| - [x] [XYZ] - Review pull request from [Person] -
| [x] Investigate error rates for [XYZ] in Sentry
|
| I look back through these documents for two reasons:
|
| 1. Right now, I have to go back through all of my notes from the
| past week for engineering sync meetings to assemble a list of
| completed tasks, then I group them by functional area, and then I
| write out a little bullet-pointed synopsis that I share with my
| peers.
|
| 2. I use my completed todo lists from the previous year to help
| fill in my annual performance evaluation. I look back through the
| entire year for major projects I worked on.
|
| I'd love to speed up both of these processes by pointing an LLM
| at all of these documents and having it auto-summarize either on
| a weekly, monthly, quarterly, or yearly basis.
| rexec wrote:
| Thanks! There's a "Summarize selection" prompt in there, so if
| you try it with a good model like Mixtral you might already get
| good results for (1). For (2) I'm guessing you'd want to be
| able to write a custom prompt?
| aaronbrethorst wrote:
| Can "Summarize selection" work across multiple documents, or
| is it limited to only a single document at a time?
|
| Also, the Notes app on macOS has a reasonably comprehensive
| AppleScript Dictionary associated with it for scripting; have
| you considered using osascript with either AppleScript (ugh)
| or JavaScript to expand your cross-document capabilities?
| rexec wrote:
| Ah yes it's limited to single documents.
|
| Using AppleScript/JavaScript to pull multiple notes is a
| good idea!
| syntaxing wrote:
| Love that workaround, extremely clever
| marcellus23 wrote:
| have you considered using Services for this? Services already
| support taking selected text and doing transformations on it, and
| allow user-configurable keyboard shortcuts. Plus it will work in
| any app, not just Notes.
| jwells89 wrote:
| Echoing this. Services and other types of macOS system plugins
| (e.g. color palette plugins) are great with how they enable
| app-agnostic functionality but are unfortunately underused.
| rexec wrote:
| That feature is so well hidden I kind of forgot it exist. I'll
| check out the selection/transformation stuff!
| kergonath wrote:
| It _is_ well hidden. It's also amazing. Services are
| available system-wide, work in any application and can be as
| sophisticated as you want, if only because you can put as
| many shell scripts as you'd like in them and then Bob's your
| uncle. It's one of the key features I miss when I use Linux.
| fiddlerwoaroof wrote:
| Yeah, Apple services are one of a bunch of semi-forgotten
| features of macOS that are real gems
| andy_xor_andrew wrote:
| On this topic (using local LLM for analyzing local text on an
| iDevice) -
|
| I highly suspect that the recent Journal app from Apple, which
| auto-installed via an iOS update, is intended to incentivize
| users to journal and write about their daily lives, so that when
| Apple inevitably ships a local LLM on iDevices, there is already
| a corpus of data for the model to RAG over and use to
| "understand" the user.
| neom wrote:
| I can't wait for higher-quality built-in proofreader on os x. I
| don't love real-time spell checkers, I'd prefer to just dump an
| email with no error highlighting, hit a keystroke and have it re-
| written proofed (with dyslexia often the only way I can find my
| own errors is by reading the text backwards). I built a GPT in
| the "built your own GPT" thinger ChatGPT has now, and I
| copy/paste stuff in, hit enter and it sends back a corrected
| version and underneath a list of the corrections it made. So far
| it's batting 1.000. I'm going to see if I can use this for that.
| bugglebeetle wrote:
| FWIW I just ran a bunch of tests with GPT 4 and it's remarkably
| bad at spelling and grammar correction.
| cadr wrote:
| Seems hugged. Look forward to looking at it when the site is back
| up - I want this exact sort of thing.
| rexec wrote:
| Should be up now (it's a static site behind Cloudflare)
| cadr wrote:
| Hm. Now getting "ERR_SSL_PROTOCOL_ERROR" in Chrome on OSX.
| rexec wrote:
| That's strange, the certificate should be valid (from Let's
| Encrypt, SHA-256 fingerprint ending in ...ccdb4). Could it
| be an issue with client time settings or an outdated
| browser cache?
| Jommi wrote:
| This is dope!
| rcarmo wrote:
| This is a very clever stunt. I do want to echo other people's
| mentions of Services, which I use for many things and will span
| multiple apps.
___________________________________________________________________
(page generated 2024-02-21 23:00 UTC)