Not_mikey
@Not_mikey@slrpnk.net
- Comment on Anthropic has developed an AI 'brain scanner' to understand how LLMs work and it turns out the reason why chatbots are terrible at simple math and hallucinate is weirder than you thought 10 hours ago:
Another very surprising outcome of the research is the discovery that these LLMs do not, as is widely assumed, operate by merely predicting the next word. By tracing how Claude generated rhyming couplets, Anthropic found that it chose the rhyming word at the end of verses first, then filled in the rest of the line.
If the llm already knows the full sentence it’s going to output from the first word it “guesses” I wonder if you could short circuit it and say just give the full sentence instead of doing a cycle for each word of the sentence, could maybe cut down on llm energy costs.
- Comment on Nvidia loses $500 bn in value as Chinese AI firm jolts tech shares 2 months ago:
It’s definitely censorship, you can see it on there app as it’s still buggy and will generate a response then halfway through it will delete it and say “sorry that’s beyond my current scope”
It did actually give a good multi paragraph response to “what is a tankie” before it realized that it was a no-no topic.
- Comment on Nvidia loses $500 bn in value as Chinese AI firm jolts tech shares 2 months ago:
It’s even worse / funnier in the app, it will generate the response, then once it realizes its about Taiwan it will delete the whole response and say sorry I can’t do that.
If you ask it “what is the republic of china” it will generate a couple paragraphs of the history of China, then it’ll get a couple sentences in about the retreat to Taiwan and then stop and delete the response.
- Comment on Germany hits 62.7% renewables in 2024 energy mix, with solar contributing 14% 2 months ago:
To be fair, Norway and those states rely heavily on hydro, which is great if you have the geography for it, but it’s not a route that can work for every region.
Excluding hydro renewable sources tend to cost more currently, though that premium has been and is coming down.
- Comment on BACK IT UP 4 months ago:
To be fair, non-mineral sunscreens do fuck with your hormones. Still better then skin cancer though.
- Comment on Feedback about our name: someone's concerns on sharing 5 months ago:
Yeah you can choose the instance your profile is on or where your browsing but you can’t choose what instance a post was made on. If I see a meme on lemmy and want to share it with a friend who doesn’t know about lemmy depending on how I get the link it could either be for the cached version on my instance or the “actual” link on the instance where it was posted. It seems the default behavior on the web ui for the share button is to do the cached version but depending what client you use this can be different.
It makes adoption harder if when people actually do try to spread posts the person on the other end is afraid to click it.