From the same Mastodon thread:
The model is known to reproduce some code, including GPL-licensed code, verbatim; therefore, it must contain verbatim copies of that code, however it is encoded.
the snippet in question is clearly, deeply original. it is a cursed coding crime that contains several “magic constants” with high entropy.
So it should be required to be open source now, right?