harryprayiv
@harryprayiv@infosec.pub
- Comment on The Oscars officially don’t care if films use AI 1 day ago:
Ahh the great hivemind pendulum where if something is hyped and has some notable cons, it’s time to throw it away completely and resist it without prejudice.
This is happening with crypto too. To me, it just signals that a person is highly perceptive to adopting whatever the hivemind tells them to think without question.
Obviously crypto and AI have some properties that make them utterly horrible (especially in the hands of bad people). But they also have some properties that have the capability to revolutionize or accomplish certain things like no other technology can.
No one seems to acknowledge this dichotomy when they’re unflinchingly under the influence of the hivemind. For example, I’m 100% positive that this comment will get downvoted heavily.
- Comment on Carney urges Canadian doctors in the U.S. to come home 2 days ago:
They’ll only come home when the healthcare profiteering stops in the US and we all know thats about as likely as the US ever having a fair election.
- Comment on Top admiral says China is outbuilding the US on warships at a shocking rate 5 days ago:
Top admiral with a job waiting in the private sector worth untold millions says we need more warships to subjugate other countries and continue destroying the planet as quickly as possible while 70,000 people a year die due to preventable illnesses.
- Comment on How likely is it that Trump will be the first President assassinated since Kennedy? 2 weeks ago:
As long as he doesn’t try to make peace with Communist nations, our MIC won’t kill him like they did to JFK*.
- That’s now a fact since the CIA files have been released.
- Comment on Which actor did not have a single bad film? 2 weeks ago:
John Cazale
- Comment on Anthropic has developed an AI 'brain scanner' to understand how LLMs work and it turns out the reason why chatbots are terrible at simple math and hallucinate is weirder than you thought 2 weeks ago:
🙏
- Comment on Anthropic has developed an AI 'brain scanner' to understand how LLMs work and it turns out the reason why chatbots are terrible at simple math and hallucinate is weirder than you thought 2 weeks ago:
To understand what’s actually happening, Anthropic’s researchers developed a new technique, called circuit tracing, to track the decision-making processes inside a large language model step-by-step. They then applied it to their own Claude 3.5 Haiku LLM.
Anthropic says its approach was inspired by the brain scanning techniques used in neuroscience and can identify components of the model that are active at different times. In other words, it’s a little like a brain scanner spotting which parts of the brain are firing during a cognitive process.
This is why LLMs are so patchy at math. (Image credit: Anthropic)
Anthropic made lots of intriguing discoveries using this approach, not least of which is why LLMs are so terrible at basic mathematics. “Ask Claude to add 36 and 59 and the model will go through a series of odd steps, including first adding a selection of approximate values (add 40ish and 60ish, add 57ish and 36ish). Towards the end of its process, it comes up with the value 92ish. Meanwhile, another sequence of steps focuses on the last digits, 6 and 9, and determines that the answer must end in a 5. Putting that together with 92ish gives the correct answer of 95,” the MIT article explains.
But here’s the really funky bit. If you ask Claude how it got the correct answer of 95, it will apparently tell you, “I added the ones (6+9=15), carried the 1, then added the 10s (3+5+1=9), resulting in 95.” But that actually only reflects common answers in its training data as to how the sum might be completed, as opposed to what it actually did.
In other words, not only does the model use a very, very odd method to do the maths, you can’t trust its explanations as to what it has just done. That’s significant and shows that model outputs can not be relied upon when designing guardrails for AI. Their internal workings need to be understood, too.
Another very surprising outcome of the research is the discovery that these LLMs do not, as is widely assumed, operate by merely predicting the next word. By tracing how Claude generated rhyming couplets, Anthropic found that it chose the rhyming word at the end of verses first, then filled in the rest of the line.
“The planning thing in poems blew me away,” says Batson. “Instead of at the very last minute trying to make the rhyme make sense, it knows where it’s going.”
Anthropic discovered that their Claude LLM didn’t just predict the next word. (Image credit: Anthropic)
Anthropic also found, among other things, that Claude “sometimes thinks in a conceptual space that is shared between languages, suggesting it has a kind of universal ‘language of thought’.”
Anywho, there’s apparently a long way to go with this research. According to Anthropic, “it currently takes a few hours of human effort to understand the circuits we see, even on prompts with only tens of words.” And the research doesn’t explain how the structures inside LLMs are formed in the first place.
But it has shone a light on at least some parts of how these oddly mysterious AI beings—which we have created but don’t understand—actually work. And that has to be a good thing.
- Comment on What are some countries you’ve visited that shocked you with unexpected friendliness? 2 weeks ago:
I’m wasn’t surprised but Mexico.
I was in the waiting room at a dentists office in Ciudad Obregón. Every single person that came in was greeted with a warm hello by every single person in the waiting room.
- Comment on [deleted] 2 weeks ago:
- Comment on [deleted] 2 weeks ago:
Lemmy
- Comment on Apple Offers Apps With Ties to Chinese Military. 3 weeks ago:
Authoritarian sheep: “Apple must provide backdoors into their software.”
Authoritarian sheep a week later: “Apple is providing backdoors into their software to any nation that asks politely! 😭”
“Let the free market rule. Let’s consider corporations super citizens that have limitless influence on governments.” ::newly ominpotent corporation does something that doesn’t benefit them::. “No not like THAT!”
- Comment on Apple Offers Apps With Ties to Chinese Military. 3 weeks ago:
Headline should read, “Apple Offer Apps
- Comment on My Thoughts on the Zen Browser 1 month ago:
Thanks for the update. I did read down the page and saw that. The dev looked really receptive, cooperative, and pro about it.
- Comment on My Thoughts on the Zen Browser 1 month ago:
Nixpkgs has been working on packaging it for more than 6 months now. I used it in an appImage and came away unimpressed. I love the minimalism but I just wish it had better security and rendered webpages better. On Brave, websites literally look sharper than on Zen.
- Comment on What are the democrats actually doing to help? 1 month ago:
My sentiments exactly. The Democrats are the party of maintaining the status quo. They make excuses that only rich, comfortable limousine liberals believe.
- Comment on The English word "four" has 4 letters. Are there any other numbers where the English name for them has that many letters? 2 months ago:
sephene
