Making the world a better place, one genetic experiment at a time.

> _

  • 68 Posts
  • 1.22K Comments
Joined 3 years ago
cake
Cake day: June 10th, 2023

help-circle
















  • Dr. Wesker@lemmy.sdf.orgtoProgramming@programming.devLLMS Are Not Fun
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    4
    ·
    edit-2
    22 days ago

    But at a certain point, it seems like you spend more time babysitting and spoon-feeding the LLM than you do writing productive code.

    I’ve found it pretty effective to not babysit, but instead have the model iterate on it’s instructions file. If it did something wrong or unexpected, I explain what I wanted it to do, and ask it to update it’s project instructions to avoid the pitfall in future. It’s more akin to calm and positive reinforcement.

    Obviously YMMV. I am in charge of a large codebase of python cron automations, that interact with a handful of services and APIs. I’ve rolled a ~600 line instructions file, that has allowed me to pretty successfully use Claude to stand up from scratch full object-oriented clients, complete with dep injection, schema and contract data models, unit tests, etc.

    I do end up having to make stylistic tweaks, and sometimes reinforce things like DRY, but I actually enjoy that part.

    EDIT: Whenever I begin to feel like I’m babysitting, it’s usually due to context pollution and the best course is to start a fresh agent session.


  • Dr. Wesker@lemmy.sdf.orgtoProgramming@programming.devLLMS Are Not Fun
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    2
    ·
    edit-2
    22 days ago

    This is extremely valid.

    The biggest reason I’m able to use LLMs efficiently and safely, is because of all my prior experience. I’m able to write up all the project guard rails, the expected architecture, call out gotchas, etc. These are the things that actually keep the output in spec (usually).

    If a junior hasn’t already manually established this knowledge and experience, much of the code that they’re going to produce with AI is gonna be crap with varying levels of deviation.


  • Dr. Wesker@lemmy.sdf.orgtoProgramming@programming.devLLMS Are Not Fun
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    8
    ·
    edit-2
    22 days ago

    It’s been my experience that the quality of code is greatly influenced by the quality of your project instructions file, and your prompt. And of course what model you’re using.

    I am not necessarily a proponent of AI, I just found myself being reassigned to a team that manages AI for developer use. Part of my responsibilities has been to research how to successfully and productively use the tech.