minus-square70k32@sh.itjust.workstoSelfhosted@lemmy.world•Selfhosted coding assistant?linkfedilinkEnglisharrow-up1·6 hours agoThis. Llama.cpp with Vulkan backend running in docker-compose, some Qwen3-Coder quantization from huggingface and pointing Opencode to that local setup with a OpenAI-compatible is working great for me. linkfedilink
This. Llama.cpp with Vulkan backend running in docker-compose, some Qwen3-Coder quantization from huggingface and pointing Opencode to that local setup with a OpenAI-compatible is working great for me.