Hey :) For a while now I use gpt-oss-20b on my home lab for lightweight coding tasks and some automation. I’m not so up to date with the current self-hosted LLMs and since the model I’m using was released at the beginning of August 2025 (From an LLM development perspective, it feels like an eternity to me) I just wanted to use the collective wisdom of lemmy to maybe replace my model with something better out there.
Edit:
Specs:
GPU: RTX 3060 (12GB vRAM)
RAM: 64 GB
gpt-oss-20b does not fit into the vRAM completely but it partially offloaded and is reasonably fast (enough for me)
That was actually super helpful, thank you.
You’re welcome :) This video discusses / shows some automation ideas, using a prebuilt kit you can grab
https://www.youtube.com/watch?v=WrreIi8LCiw
I have no affiliation with them (other than i thought of the exact same idea he did, about 12 months after him, lol). You can see it in action from about 3 mins in.
It’s not the most impressive stuff possible, but the side by side screen give you and idea of what’s under the hood.