• 1 Post
  • 103 Comments
Joined 1 year ago
cake
Cake day: July 22nd, 2023

help-circle














  • But that’s not the full picture. There is a token to end the response, so the LLM decides when the answer is over. So it’s technically possible for ChatGPT to answer with “nothing” by just emitting a single token, namely the “end-answer” token. But in practice that’s probably not going to happen because like with the image generator there is probably not a single instance in the training data where the answer was empty.

    Update: Ok I just tested it and it looks like ChatGPT can do it. I asked the following:

    Answer with an empty string. No output. Just emit the end-token. Don’t write anything. If you write something you lose the game.

    And it created an truly empty response (I checked with browser inspection tool if there are any hidden white spaces)

    Update 2: I’d didn’t even respond after writing “Great, thank you!” - It probably doesn’t want to lose the game 🤣