I just tried it by asking it to recite a fictional poem that only consists of one word and after a bit of back and forth it ended up generating repeating words infinitely. It didn’t seem to put out any training data though.