Looking for an advanced knowledge base / intelligence analysis tool?
reddit / selfhosted

----------------------------------------------------------------------
NoeticIntelligence · 2023-10-09 19:21

I have been using Evernote for a long time.

I have over one million notes, spread across different notebooks
(a majority not loaded all the time).

With that comes the meta data possible in Evernote.
Keywords, comments, links, categories, etc.

I would like to unify all of it in an intelligence anlysis tools,
with meta data, keywords, links, comments, photos, documents (e)books,
and so on.  Awesome intelligent search features.

I dont want to create XML/Json stubs and stuff it all into Elastic
Search
or something similar.

I want something smarter.

A wiki could be built and written on top of it, but in itself the
pile of notes dont lend themselves to be modelled as a wiki in itself.

I have no idea if something like this exists.

----------------------------------------------------------------------
jonahbenton · 2023-10-09 19:35

It's bleeding edge but some folks are doing this with local LLMs.

----------------------------------------------------------------------
Puzzleous · 2023-10-09 20:13

[Obsidian](https://obsidian.md/) might be along the lines of what
you're looking for, except for the wiki part. However, you *can*
search and build complex relationships with notes via the graph
functionality which might accomplish the same thing.

----------------------------------------------------------------------
wit2008 · 2023-10-09 20:25

/r/logseq

----------------------------------------------------------------------
lilolalu · 2023-10-09 21:41

Just came across this today, maybe that would be interesting for you:

https://github.com/arc53/DocsGPT

----------------------------------------------------------------------
Kev-wqa · 2023-10-10 08:58

part of me wants to browse your database of notes...

Why so many, what kinda topics?

----------------------------------------------------------------------
NoeticIntelligence · 2023-10-10 09:06

Thank you.
I have tried it, and it does not do well with the size I have now.
What i should have added was a server side solution.

----------------------------------------------------------------------
NoeticIntelligence · 2023-10-10 09:06

thank you.
I will check it out.

----------------------------------------------------------------------
mirisbowring · 2023-10-10 09:08

Well, you just need an a10g gpu 😄

----------------------------------------------------------------------
NoeticIntelligence · 2023-10-10 09:13

The number of notes is partially a result since I have been doing this
for a very long time.

Partially because I am a bit obsessed.

There are many distinct categories.
The biggest one has to do with current events and history
back to the end of WW2.

And within that are a lot of analysis and research I have performed.

One smaller example is a deep dive into the climate Paris (Accords,
Treaty, Agreement).

Then there si a category with what to me are important things I have
learned and note about how to solve various practical problems and
failures. Because I keep forgetting the solutions.

Then articles I have written, creative writing and a massiv amount of
research for that.

and so on :)

----------------------------------------------------------------------
lilolalu · 2023-10-10 09:41

A10G small on huggingface 1.05$ /hr

A10G large on huggingface 3.15$/hr

A40 on vast.ai 0.4$/hr

----------------------------------------------------------------------
Kev-wqa · 2023-10-10 12:27

If you ever create a blog please share it.

Actually I started reading Saipans recently and started taking notes
on my research or "pre-humans". Interesting stuff. Not quite a million
tho haha.