Yeah. I have actually set up machine learning systems incorporating LLMs to do things sort of vaguely similar to this. That little statement about how the context window may have gotten to where the old stuff aged out of it, so that all the context it could see was conversations with the staffers about the glorious communist revolution, indicates to me that they don’t know the first thing about what the fuck they are doing. That’s just not how you do it, even if an LLM is one component of how you want to do it.
What an incredibly stupid thing to do. LLMs are not the correct tool for this problem. Especially not like this.
Yeah. I have actually set up machine learning systems incorporating LLMs to do things sort of vaguely similar to this. That little statement about how the context window may have gotten to where the old stuff aged out of it, so that all the context it could see was conversations with the staffers about the glorious communist revolution, indicates to me that they don’t know the first thing about what the fuck they are doing. That’s just not how you do it, even if an LLM is one component of how you want to do it.