Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

  • cryball@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    1 year ago

    But the naysayers will argue that your problem is not novel and a solution can be trivially deduced from the training data. Right?

    I really dislike the simplified word predictor explanation that is given for how LLM’s work. It makes it seem like the thing is a lookup table, while ignoring the nuances of what makes it work so well.

    • ioen@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      1 year ago

      But the naysayers will argue that your problem is not novel and a solution can be trivially deduced from the training data. Right?

      Yes, obviously. Unless @Serdan is publishing papers about their solutions to previously unsolved computation problems, we should assume that by “novel problem” they actually just mean “a mundane problem for which every step of the solution is trivial, even if they’ve never been combined in that exact order before”.