ct -> d is a not-uncommon OCR fuck up. Maybe that’s the source of it’s garbage data?
The famous ‘invisible D’ of Connecticut, my favorite SCP.
iamdefinitelyoverthirteen@lemmy.world 3 weeks ago
leftzero@lemmy.dbzer0.com 3 weeks ago
No, LLMs produce the most statistically likely (in their training data) token to follow a certain list of tokens (there’s nothing remotely resembling reasoning going on in there, it’s pure hard statistics, with some error and randomness thrown in), and there are probably a lot more lists where Colorado is followed by Connecticut than ones where it’s followed by Delaware, so they’re obviously going to be more likely to produce the former.
Moreover, there aren’t going to be many texts listing the spelling of states (maybe transcripts of spelling bees?), so that information is unlikely to be in their training data, and they can’t extrapolate because it’s not really something they do and because they use words or parts of words as tokens, not letters, so they literally have no way of listing the letters of a word if said list is not in their training data (and, again, that’s not something we tend to write). Same with counting how many letters a word has, and stuff like that.
ICastFist@programming.dev 3 weeks ago
SCP-00WTFDoC (lovingly called “where’s the fucking D of Connecticut” by the foundation workers, also “what the fuck, doc?”)
People think it’s safe, because it’s “just an invisible D”, not even a dick, just the letter D, and it only manifests verbally when someone tries to say “connecticut” or write it down. When you least expect it, everyone heard “Donnedtidut”, everyone read that thing and a portal to that fucking place opens and drags you in.
ripcord@lemmy.world 3 weeks ago
Words are full of mystery! Besides the invisible D, Connecticut has that inaudible C…
Rcklsabndn@sh.itjust.works 2 weeks ago
I hear the Invisible D and Silent C are happily married.
kuberoot@discuss.tchncs.de 3 weeks ago
That actually sounds like a fun SCP - a word that doesn’t seem to contain a letter, but when testing for the presence of that letter using an algorithm that exclusively checks for that presence, it reports the letter is indeed present. Any attempt to check where in the word the letter is, or to get a list of all letters in that word, spuriously fail. Containment could be fun, probably involving amnestics and widespread societal influence, I also wonder if they could create an algorithm for checking letter presence that can be performed by hand without leaking any other information to the person performing it, reproducing the anomaly without computers.