Which of the following sounds more reasonable?

  • I shouldn’t have to pay for the content that I use to tune my LLM model and algorithm.

  • We shouldn’t have to pay for the content we use to train and teach an AI.

By calling it AI, the corporations are able to advocate for a position that’s blatantly pro corporate and anti writer/artist, and trick people into supporting it under the guise of a technological development.

  • Muehe@lemmy.mlEnglish
    1·
    1 year ago

    Could you elaborate on what you mean about the development of deep learning architecture in recent years?

    Transformers. Fun fact, the T in GPT and BERT stands for “transformer”. They are a neural network architecture that was first proposed in 2017 (or 2014 depending on how you want to measure). Their key novelty is the method of implementing an attention mechanism and a context window without recursion, which was the method most earlier NNs used for that.

    The wiki page I linked above is admittedly a bit technical, this articles explanation might be a bit more friendly to the layperson.

    • pensivepangolin@lemmy.worldEnglish
      1·
      1 year ago

      Thanks for the reading material: I’m really not familiar with Transformers other than the most basic info. I’ll give it a read when I get a break from work.