Imagine you need to write a long piece of text that requires you to think things through, gather information, and analyze it. Then you have to write the text itself, proofread it, correct any errors, and refine the wording. Let’s say you spend 10 hours on this task. Now
Are you using an IDE? Ewww, that’s so heavy-handed. I use a text editor.
Are you using a text editor? Ewww, that’s so heavy handed. I use Unix pipes to edit the files.
Are you using Unix pipes? Ewww, I use a microscopic needle to edit files on the hard drive platter.
Eventually this reaches absurdity in the other direction too. If working your AI is like wrangling cats, maybe you need to update to a newer model.
And maybe just maybe… You’re asking too much of the model/VRAM combo available.
If an LLM is not the right tool for the job, that’s okay too.