As someone who had his relatively fine and deterministic scripts replaced by skill.md bullshit by coworkers – no. This is exactly the things AI is the worst fit for.
We’ve already ran into it halucinating complete result data-set, because it ran into an error but the skill mentioned that it should give the results data to the user. So it just made it up, since it couldn’t get it by following the correct process.
It has also ran wrong builds or input parameters, because it confused their order.
I’ve also seen it skip a step.
I’m pretty confident that the AI running this script will eventually, for someone, run into an issue with getting one of the dependencies, and go on a wild goose chase in trying to satisfy it, eventually running into one of the typosquatting malware repositories or clones. Not to mention that there are groups that are actively poisoning AIs that search the web to feed them their malware-ridden typosquatting libraries instead.
If you suck so much you can’t write a simple script like this (or just can’t be bothered), you should at least just ask the AI to write it for you, so you have a deterministic set of steps that you are confident will always behave the same.
As someone who had his relatively fine and deterministic scripts replaced by skill.md bullshit by coworkers – no. This is exactly the things AI is the worst fit for.
We’ve already ran into it halucinating complete result data-set, because it ran into an error but the skill mentioned that it should give the results data to the user. So it just made it up, since it couldn’t get it by following the correct process.
It has also ran wrong builds or input parameters, because it confused their order.
I’ve also seen it skip a step.
I’m pretty confident that the AI running this script will eventually, for someone, run into an issue with getting one of the dependencies, and go on a wild goose chase in trying to satisfy it, eventually running into one of the typosquatting malware repositories or clones. Not to mention that there are groups that are actively poisoning AIs that search the web to feed them their malware-ridden typosquatting libraries instead.
If you suck so much you can’t write a simple script like this (or just can’t be bothered), you should at least just ask the AI to write it for you, so you have a deterministic set of steps that you are confident will always behave the same.
You can do fun things with hooks to make sure they don’t skip steps. but yes I agree with you that this is terrible.