• Pennomi@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    3 days ago

    Well yeah, it’s working from an incomplete knowledge of the code base. If you asked a human to do the same they would struggle.

    LLMs work only if they can fit the whole context into their memory, and that means working only in highly limited environments.

    • Maalus@lemmy.world
      link
      fedilink
      arrow-up
      13
      ·
      3 days ago

      No, a human would just find an API that is publically available. And the fact that it knew the static class “Misc” means it knows the api. It just halucinated and responded with bullcrap. The entire concept can be summarized with “I want to color a player’s model in GAME using python and SCRIPTING ENGINE”.