Comment on Little Bobby Tables has a baby sister. Meet Sally Ignore Previous Instructions.
minorninth@lemmy.world 7 months agoI’m talking about using the ChatGPT API to make a chat bot. Even when the user’s input is just one sentence, it can cause ChatGPT to forget its prompt.
vcmj@programming.dev 7 months ago
Ah, even then it could just be a consequence of training samples usually being chronological so it learns to think that way. I did find the pattern also applies to GPT trained on long articles where you’d expect it not to, so wanted to just explain why that might be.