I’m wondering how to effectively keep track of the data I hoard. I’m almost at 80TB and currently use very basic folders structure to keep track of my data. I’m looking for something like a full text index maybe even a like a search engine for local data? Is there such a tool?
Where do you store 80TB of data, is it backed up?
Yes, I have two rackmounted synology nas servers and one diy running unraid
To answer your question, I search my (albeit smaller) amount of data with Kiwix if it’s a zim file, if not, the search function in Nautilus allows me to search the contents of text files.
Kiwix sounds interesting, thanks. Still looking for something that indexes my NAS though.
If found https://www.diskoverdata.com/ but that looks a bit overkill to me.
I just organize it properly in a folder structure that makes sense to me. No need to do anything more complicated if you’re organized.
I do this too, and avoid as much as possible having folders within folders, eg;
me-photos
me-music
me-documents
john-photos
john-music
work-documents
work-letter-templatesAnd so on. Sort by name.
Thanks, I’ll check it out
Use some kind of hierarchical folder-structure like the Usenet does.
Something like: unix.desktop.theming for all your desktop ricing/theming stuff, unix.lx.debian.doc for debian documentation, win.win10.winget for everything related to winget on windows 10, rl.bureau.finances for your finances, accounting, etc. …You can use the Browser Extension “QuickCut” to save your bookmarks in folders. Its really helpful when you work on a bigger project and have all the documentation weblinks at hand.