• flan [they/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    31
    ·
    edit-2
    2 months ago

    I dont think this LLM in everything trend is going to last very long. It’s way too expensive for it to be in literally all consumer things. I can imagine it finding some success in B2B applications but who is going to pay Logitech to pay OpenAI $30 per million tokens? (Lambda for comparison is $0.20 per 1M requests if you pay the public rate)

    • FourteenEyes [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      23
      ·
      2 months ago

      There will be another massive financial recession when it finally dawns on them this shit was never gonna make any fucking money for anyone

      • Owl [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        27
        ·
        2 months ago

        The crypto bubble lasted a long time, and unlike it, AI actually does something (not anything useful, or terribly well, but something), so I expect the bubble will last a while yet.

    • Monument@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      2 months ago

      I disagree, because I think what will happen is that these companies won’t use “AI” that is hosted in the cloud, but will instead send some minimally functional model to users that runs on their GPU, and later NPU (as those become common), and engage in screen recording and data collection about you and everything the mouse clicks on.
      Disabling AI/data collection will disable any mouse technology or feature implemented after 1999, because AI or something.

      At this point, I think AI stands for “absolute intrusion” when it comes to consumer products.

      • flan [they/them]@hexbear.net
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 months ago

        I don’t really see why they need AI for that but yes I imagine companies will want to deploy AI on user equipment. These aren’t going to be nearly as sophisticated or useful as what can run in the cloud though.