vrighter
@vrighter@discuss.tchncs.de
- Comment on Patient gamers, which games have you discovered/played this week? 1 week ago:
to avoid disappointment: It doesn’t end… it just… stops
- Comment on Dropbox lays off 20% of staff, says it overinvested and underperformed 3 weeks ago:
going to “C:\Users\user\Documents” in explorer, vs just typing in “documents”. One takes you to your documents folder, which will be empty, the other takes you to some other path from onedrive
- Comment on Concerns Raised Over Bitwarden Moving Further Away From Open-Source 4 weeks ago:
on some sites the plugin fails to properly detect which fields correspond to which, true (usually when javascript fuckery is involved). But fixing that by manually pointing out the fields once on such sites is easy enough for me. I also switched firefox to use keepassxc for passkeys, which makes them actually portable and usable for me.
- Comment on 2 in 3 People Often Encounter Hate Speech Online. 4 weeks ago:
asking such an open ended question doesn’t mean much when nowadays, more and more people consider “anything I don’t agree with” to be hate speech.
- Comment on Concerns Raised Over Bitwarden Moving Further Away From Open-Source 4 weeks ago:
what sucks about keepassxc?
- Comment on I have the weirdest aesthetic preferences 1 month ago:
i hate coding for browsers. To that end, I do not actually know css. I just called it padding when I wrote my own qr code library, because it was easier to say than “quiet zone”.
Just like “dots” or “pixels” are easier to say than “modules”
- Comment on Nintendo Is Now Going After YouTube Accounts Which Show Its Games Being Emulated 1 month ago:
playing nintendo games, on a pc, using a dualshock feels so wrong and yet so right
- Comment on I have the weirdest aesthetic preferences 1 month ago:
the bottom one is not a qr code. The padding is part of it.
- Comment on California governor vetoes bill to create first-in-nation AI safety measures. 1 month ago:
anyone remember the anarchist’s cookbook?
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
randomly doesn’t mean equiprobable. If you’re sampling a probability distribution, it’s random. Temperature 0 is never used, otherwise a lot of stuff would consistently hallucinate the exact same thing
- Comment on God of War Ragnarok Mod Removes PSN Requirement and Creator Vows to Maintain It 1 month ago:
they can’t if they distribute the mod as a patch, “for educational purposes”
The patch does not contain anything proprietary.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
if it’s allowed to use its own interactions as data, it will collapse. This has been studied. Stuff just does not work the way you think it does. Try coding one yourself i d
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
The llm does not give you the next token. It gives you a probability distribution of what the next token coould be. Then, after the llm, that probability distribution is randomly sampled.
You could add billions of attention heads, it will still have an element of randomness in the end. Copilot or any other llm (past, present or future) do have this problem too. They all “hallucinate” (have a random element in choosing the next token)
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
turning jhonny into an llm does not work. because that’s not how the kid learns. kids don’t learn math by mimicking the answers. They learn math by learning the concept of numbers. What you just thought the llm is simply the answer to 2+2. Also, with llms there is no “next time” it’s a completely static model.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
yeah. what’s your point. I said hallucinations are not a solvable problem with LLMs. You mentioned that alpaca used synthetic data successfully. By their own admissions, all the problems are still there. Some are worse.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
from their own site:
Alpaca also exhibits several common deficiencies of language models, including hallucination, toxicity, and stereotypes. Hallucination in particular seems to be a common failure mode for Alpaca, even compared to text-davinci-003.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
here’s that same conversation with a human:
“why is X?” “because y!” “you’re wrong” “then why the hell did you ask me for if you already know the answer?”
What you’re describing will train the network to get the wrong answer and then apologize better. It won’t train it to get the right answer
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
Yeah that implies that the other network(s) can tell right from wrong. Which they can’t. Because if they did the problem wouldn’t need solving.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
the problem isn’t being pro ai. It’s people puling ai supposed ai capabilities out of their asses without having actually looked at a single line of code. This is obvious to anyone who has coded a neural network. Yes even to openai themselves, but if they let you believe that, then the money stops flowing. You simply can’t get an 8-ball to give the correct answer consistently. Because it’s fundamentally random.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
yes it is, and it doesn’t work
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
also, what you described has already been studied. Training an llm its own output completely destroys it, not makes it better.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
The outputs of the nn are sampled using a random process. Probability distribution is decided by the llm, loaded die comes after the llm. No, it’s not solvable.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
nothing to do with all that. The explanation is simple. The output of the llm is sampled using a random process. A loaded die with probabilities according to the llm’s output. It’s as simple as that. There is literally a random element that is both not part of the llm itself, yet required for its output to be of any use whatsoever.
- Comment on A courts reporter wrote about a few trials. Then an AI decided he was actually the culprit. 1 month ago:
why did it? because it’s intrinsic to how it works. This is not a solvable problem.
- Comment on OpenAI Threatening to Ban Users for Asking Strawberry About Its Reasoning 1 month ago:
I’ve met someone employed as a dev, who not only didn’t know that the compiler generates an executable file, but actually spent a month trying to change the code, not noticing that 0 of their code changes were having any effect whatsoever (because they kept running an old build of mine)
- Comment on Qualcomm Reportedly Taps Intel With An Acquisition Offer 1 month ago:
no, intel pay amd to use the 64 bit instruction set. amd pay intel to support the 32 bit instruction set.
- Comment on What’s the most overhyped tech trend right now? 1 month ago:
it has the potential to revolutionize some optimization problems that are hard to solve classically. It’s going to be practically useless for the average user.
- Comment on What’s the most overhyped tech trend right now? 1 month ago:
yeah but they are all completely crippled by a touchscreen
- Comment on Microsoft inks deal to restart Three Mile Island nuclear reactor to fuel its voracious AI ambitions 1 month ago:
as opposed to just spewing it out in the air? (carbon 14 is a thing, those things emit a lot more radioactivity to the environment)
- Comment on God of War Ragnarok PC port suffers review bombing on Steam due to PlayStation Network account requirement 1 month ago:
exactly. Their complaints are actually relevant to the game, not some unrelated ideology