Submitted 11 months ago by L4s@lemmy.world [bot] to technology@lemmy.world
OpenAI was working on advanced model so powerful it alarmed staff::Reports say new model Q* fuelled safety fears, with workers airing their concerns to the board before CEO Sam Altman’s sacking
I’m so burnt out on OpenAI ‘news’. Can we get something substantial at some point?
AI, Twatter, Tesla - there’s hardly anything else in this community… :(
It’s just such a relief that you’re doing your daily best to post the content we all so clearly need from this community. I’ve been meaning to thank you for your hard work.
Trump 🙄
There’s a huge discrepency between the scary warnings about Q* calling it the lead-up to artificial superintelligence, and the actual discussion of the capabilities of Q* (it is good-enough at logic to solve some math problems).
My theory: the actual capabilities of Q* are perfectly nice and useful and unfrightening… but somebody pointed out the obvious: Q* can write code.
Either
“Q* is gonna take my job!”
“As we enhance Q*, it’s going to get better at writing code… and we’ll use Q* to write our AI code. This thing might not be our hypothetical digital God, but it might make it.”
Did they really have to name it Q?
It’s going to create a super intelligent AI that’s more irritating than anything else.
It’s possible it’s related to the Q* function from Q-learning, a strategy used in deep reinforcement learning!
It’s apparently Q* (pronounced Q star).
At least they didn’t name it AM?
Nah. Programming is… really hard to automate, and machine learning more so. The actual programming for it is pretty straightforward, but to make anything useful you need to get training data, clean it, and design a structure, which is much too general for an LLM.
Programming is like 10% writing code and 90% managing client expectations in my small experience.
The sensationalized headline aside, I wish people would stop being so dismissive about reports of advancement here. Nobody but those at the fringes are freaking out about sentience, and there are plenty of domains where small improvements in the models can fuck up big parts of our defense/privacy/infrastructure if they end up being successful. It really doesn’t matter if computers have subjective experience, if that computer is able to decrypt AES-192 or identify keystrokes from an audio recording.
We need to be talking about what happens after AI becomes competent at even a handful of tasks, and it really doesn’t inspire confidence if every bit of news is received with a “LOL computers aren’t conscious GTFO”.
That’s why I hate when people retort “GPT isn’t even that smart, it’s just an LLM.” Like yeah, the machines being malevolent is not what I’m worried about, it’s the incompetent and malicious humans behind them. Everything from scam mail to propaganda to law enforcement is testing the water with these “not so smart” models and getting incredible (for them) results. Misinformation is going to be an even bigger problem when it’s so hard to tell what you can believe.
I’m even more afraid of the competent evil people
Also “Yeah what are people’s minds really?”. The fact that we cannot really categorize our own minds doesn’t really mean that we’re forever superior to any categorized AI model. The mere fact that right now that bleeding edge is called an LLM doesn’t mean that it cannot fuck with us - especially if it is an even more powerful one in the future.
Pure propaganda. The only safety fears anyone in the industry is going to have is if a model is telling people to kill themselves or each other. But by saying that, The uneducated public is going to assume it’s skynet.
Why must it always be propaganda in the Fediverse? Why can’t it be a more sensible take like sensationalization? Not everything is out to get you, you know, sometimes a desperate website/newspaper just wants a click or a reader.
Sensationalization infers that it happened and media turned it into misunderstood clickbait.
If the company designed the PR stunt and executed the PR stunt that would be propaganda.
Because the political zeitgeist here is dominated by edgy teenagers who still see the world as something done to them instead of something they are doing. It’s extremely obvious of you’ve been through that phase of life already.
The only safety fears (…) people to kill themselves (…)
Hu ? The following might be worse :
The Pentagon is moving toward letting AI weapons autonomously decide to kill humans
lemmy.world/post/8715340
Not related what so ever to llm
Allegedly. And no proof was presented. The letter cited was nowhere to be found.
This is the best summary I could come up with:
OpenAI was reportedly working on an advanced system before Sam Altman’s sacking that was so powerful it caused safety concerns among staff at the company.
The artificial intelligence model triggered such alarm with some OpenAI researchers that they wrote to the board of directors before Altman’s dismissal warning it could threaten humanity, Reuters reported.
The model, called Q* – and pronounced as “Q-Star” – was able to solve basic maths problems it had not seen before, according to the tech news site the Information, which added that the pace of development behind the system had alarmed some safety researchers.
The reports followed days of turmoil at San Francisco-based OpenAI, whose board sacked Altman last Friday but then reinstated him on Tuesday night after nearly all the company’s 750 staff threatened to resign if he was not brought back.
As part of the agreement in principle for Altman’s return, OpenAI will have a new board chaired by Bret Taylor, a former co-chief executive of software company Salesforce.
However, his brief successor as interim chief executive, Emmett Shear, wrote this week that the board “did not remove Sam over any specific disagreement on safety”.
The original article contains 504 words, the summary contains 192 words. Saved 62%. I’m a bot and I’m open source!
So did anyone interview the sister? No? Hm.
I read that blog post about her. I thought it all sounded pretty wild - perhaps real and perhaps not. If she really believes what she says, she needs to hire a lawyer and file charges if she thinks there’s a crime.
Instead she’s making these periodic accusatory posts containing big claims without evidence, which serves more as an antagonizer/libelous effort than one to achieve justice. It doesn’t rise to the standard we expect to find guilt.
My name’s gpt. Chat gpt. Q, what are my orders?
Darkassassin07@lemmy.ca 11 months ago
So staff requested the board take action, then those same staff threatened to quit because the board took action?
That doesn’t add up.
FrostyTrichs@lemmy.world 11 months ago
The whole thing sounds like some cockamamie plot derived from chatgpt itself. Corporate America is completely detached from the real world.
db2@sopuli.xyz 11 months ago
That’s exactly what it is. A ploy for free attention an be it’s working.
bionicjoey@lemmy.ca 11 months ago
OpenAI loves to “leak” stories about how they’ve developed an AI so good that it is scaring engineers because it makes people believe they’ve made a massive new technological breakthrough.
Taleya@aussie.zone 11 months ago
Meanwhile anyone who works tech immediately thinks “some csuite dickhead just greenlit ED-209”
RedditWanderer@lemmy.world 11 months ago
More like:
They get a breakthrough called Q* (Q star) which is just combining 2 things we already knew about.
Chief scientist dude tells the board Sam has plans for it already
Board says Sam is going to fast with his “breakthroughs” and fires him.
Original scientist who raised the flag realized his mistake and started supporting Sam but damage was done
Microsoft
My bet is the board freaked out at how “powerful” they heard it was (which is still unfounded and from what they explain in various articles, Q* is not very groundbreaking) and jumped the gun. So now everyone wants them to resign because they’ve shown they’ll take drastic actions without asking on things they don’t understand.