Return to Level1Techs.com

The Ultimate Home Server - Component: Knowledge Repository

  • Knowledge Repository
    – perhaps the most important aspect of my home server is that it is my brain outside my brain. I need a wiki to store stuff and keep track of things. I need something to store and keep track of my books BUT ALSO my notes in books.
    – love something that integrates with all my old written notes that have been digitized. Used LiveScribe for almost a decade. The new pens don’t do it for me anymore, though.

What do you use? How well is it working? How do you organize your thoughts? OneNote from microsoft isn’t too bad and with OfficeLens it can work really well.

LiveScribe was amazing for making notes of meetings. You could make notes but also use your written notes as a playback device – touch a written word on the page and jump to the audio of the meeting where that node was made. Automagically Something was lost when it became too tightly integrated into your phone for this functionality to work as well as it had. I haven’t used LiveScribe in 5 years as a result.

10 Likes

I’ve never come to a good solution for this. If anyone can suggest something fast and easy, please do share.

I’ve been using vimwiki hooked up to git for a while and it’s alright, but I keep forgetting to pull on whatever machine I’m on, so I wind up needing to rebase my a wiki. :roll_eyes:

2 Likes

Do people still use Evernote? I had a friend who used it to document everything and also used it to package up his work to provide as documentation for system implementations.

I never really figured it out but it seemed like a decent tool.

2 Likes

I used it a while back, and it was really good, I just hated that I can’t trust it for sensitive notes. I don’t want to store 2fa recovery keys or anything… still don’t fully trust it.

2 Likes

I never really found a great solution, but a good enough option for me is Microsoft OneNote. I’d love to self host something, but it’s very difficult to get a feature set OneNote provides.

While I had my share of “‘the fuck you doing’ Microsoft?”, OneNote is actually well designed, and works on most devices, even the web app version is good.
Very useful for me is their collaboration with Samsung. All office apps work on Galaxy phones and their desktop mode and OneNote integrates really well with s-pen, you can just pull the pen out on the lock screen, jot something down and put it back and voila - it can sync from your Samsung notes to OneNote. It can OCR your notes even if they are not in English, and that it’s very useful for the rest of us :slight_smile:.

I don’t know, plenty to like but I have that anxiety that I always depend on Samsung and Microsoft, and since apparently Samsung is not doing the Note thing anymore a very expensive solution is going to get even more expensive as only option will be a foldable one.

7 Likes

I’m cheating here: there’s a list of software goauthentik has instructions for how to integrate with, so you can have centralized accounts and 2FA and/or oauth and/or AD integration, etc etc.

I found a few things on the list:

  • Bookstack
  • Hedgedoc
  • Wiki.js
  • Vikunja

I think I like the idea of throwing things into hedgedoc on their way to a project related git repo,…

… or just using the hedgedoc for drafting notes

… but I recognize this is very developer centric and not very family friendly… and a very 90s sysadmin/early 2000s approach to doing things… very text oriented.

Also, a wiki might be closer to something like a corporate CMS where non-git users can publish instructions for how to get company logo t-shirts or where Karen and Bob from accounting can put in instructions with example screenshots explaining where you can download your payslips.


Not the same, but, Google Meet supports captions, and random people have built chrome extensions to pipe captions into various places.

edit: just found / remembered Linux unplugged podcast mentioned GitHub - audapolis/audapolis: an editor for spoken-word audio with automatic transcription … need to check it out

3 Likes

I use MediaWiki but not at home, I have used it for my notes publicly at https://lathama.net so that I can access my mess fast from any system.

1 Like

I use onenote as well

2 Likes

I use, besides local text files for temporary notes, https://cryptpad.fr.

It’s an E2E-Encrypted Browser-Based Collaboration Suite.
Basically a GPL-Licensed Google Suite Alternative with some added but also many missing features.
Open-Source and trustable in contrast to Big Tech.

Following Functions I use:

  • Cloud Storage Functionality to Back Up Key Configuration Files
  • Richt Text Files for Documentation
  • Code Files to Store Code Pieces
  • Kanban to Organize Goals / Workflows

Self-Hosting is also an option, though that depens on what ones homelab looks like. I wouldn’t want to store all Documentation on how to Restore Backups on the same server I’m having to restore.
For most purposes the Free Tier with 1GB Storage should provide enough storage for Documents.

1 Like

This is something that I am actively researching. I currently use NextCloud for simple file storage and sync but that is boring and normal. :stuck_out_tongue:

However I am building something that is inspired by Vannevar Bush‘s idea of a sort of intelligent library. I want something that I can dump PDFs and other documents in and it build a sort of complex network of relationships between the documents using machine learning and AI. This is something that is related to my academic research in cybernetics.

6 Likes

I use https://obsidian.md/ for this. I believe I initially read about it somewhere else on this forum and found myself very impressed, enough to begin a neverending process of switching to it. It’s a tree style markdown editor, meaning it can support including images, internal links and such but gets more powerful.

I migrate from onenote/ plain text files & folders for pdf’s in this regard and don’t feel it’s a downgrade on anything I required, with significant improvements in some e.g. tolerates code segments far better.

For e.g. mobile access I sync the KB directory tree to a cloud service location with unison so can edit/ receive from mobile app.

8 Likes

The only issue I have is that they want you to pay for sync.

2 Likes

I use a mixture of Notion and a locally installed Docuwiki instance in my Homelab. I am struggling to find a solution that works myself. I am finding myself shifting more towards using Notion and using the wiki for things that I don’t believe I will need to use outside my home. I am beginning to believe that even if there was a perfect tool, maintaining my notes and the data seems to become a bigger and bigger task as I take more notes.

2 Likes

i’ve seen good workflows where a “writer” uses https://typora.io/ to create markdown files that can then be automatically parsed for whatever. bash, etc may be needed, but that sounds like just enough anti windows to pursue :slight_smile:

Edit
this does make me think of the previous dream painted by digital asset management systems such as telescope back in the 2000’s. an ingestion system that will tag, and classify your assets to make them easier to find and stitch into future ideas more easily. maybe we should abstract this and look at how we wish to ingest, parse, and ultimately spread the information to whoever may need it as they query or “ask”. either way, totally down for this.

2 Likes

I used to use notepad++, and then made use of zimwiki for a while, but it had some shortcomings that I couldn’t stick with. I now use and enjoy Joplin for my piles and piles of markdown notes. My hope is that one day I’ll finally have enough notes that my ADHD cures itself.

  • I really like the organisation of:
        Notebook
                    ▼ Subnotebook ➞Note1
                                               ➞Note2
    setup that it has. Much easier to jump around. Notebook apps that only have one or two levels are awful. Subnotebooks are optional, and you can keep nesting them.
  • Open Source
  • Works on linux, windows, various Android, ios (this one is broke), and macs.
  • There’s even a terminal version for you freaks: https://joplinapp.org/terminal
  • You can sync with a variety of paid and host-it-yourself ways
  • It’s especially easy to archive files or a webpage with firefox’s “Save Page WE”, and then embed the page so it stays with the note files forevermore. There’s also a webclipper I’ve not bothered to setup, since I’m as likely to embed a file as a I am a page and my way works fast enough.
  • Can display pictures
  • Can easily drag and drop notebooks and subnotebooks around, though it’s a bit finicky until you figure it out
  • Plugin system
  • No hassle themes, various dark modes

Some oddities

  • Note that there are PDF previews on by default, which can be disabled in the settings, which is a must for embedding IMO.
  • Joplin has a phone app, but on my iphone it’s broke as hell. I really need to report this. I’ll make a note…
  • The first start might take a while. On windows it may hide itself hide itself in the little hidden icons

Two other disappointing things which honestly limit the project. If I jump to another project, it’s gonna be these reasons.

One thing that could be a dealbreaker is that the notes are stored in a .sqlite database. So if you have things that depend on folders full of .txt files then you may have a bad time.

5 Likes

So I have made a bit of progress on my project. The general plan is to build complex networks of documents where some the relationships between documents are characterised by machine learning algorithms of different types. I think of these as layers in the network. The first layer I am developing is relationships between shared topics that are discovered by topic modelling. So the first thing I have developed is software that does the topic modelling. Now I have to calculate the distances between the topics of different documents, that will give me a sense of how similar in terms of modelled topics any two documents are.

This will take a bit longer I think.

2 Likes

I still use Evernote… every day. I think it’s overlooked is because there was not much on great new features (that are actually good still present) for a long time. But give it a shot, its really good.

1 Like

I use Evernote as well and think it has a well-rounded feature set. I’m looking for a self-hosted version that checks all those boxes.

1 Like

So brainstorming on a requirements list, here’s some of the things I personally would like, but I doubt there’s anything out there that meets all of these wants:

  • Self hosted
  • All notes/documents/books/todos/calendar stored in a file system so that I can just open the file if i want instead of going through the various interfaces.
  • Basic text based notes
  • Markdown file support
  • For more advanced formatting ODT file support
  • Handwritten notes, ideally stored in a vector format like SVG
  • Handwriting OCR for converting handwritten notes to text
  • A way to link notes/documents/whatever together
  • A unified search of the data
  • Cross device/platform sync for offline access
  • For spreadsheets ODS file support
  • voice notes
  • speech recognition for converting voice notes to text
  • document detection/flattening for pictures of documents/books
  • OCR for getting text out of pictures of documents/books
  • A web interface for accessing on non-personal devices
  • Native applications for accessing on personal devices (linux, mac, windows, android, ios)
  • Hybrid voice/text/handwritten note taking where the text/handwritten note is time coded to the audio.
7 Likes

I use Org mode in emac and sync the file with nextcloud. But im not convice with it in mobile.

1 Like