AliasAKA
@AliasAKA@lemmy.world
- Comment on Nvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiece 1 day ago:
This already happens intrinsically in the models. The tokens are abstracted in the internal layers and only translated in the output layer back to next token prediction. Training visual models is slightly different because you’re not outputting tokens but pixel values (or possibly bounding boxes or edges, but not usually; conversely if not generative you may be predicting labels which could theoretically be in token space).
The field itself is actually fairly stagnant in architecture. It’s still just attention layers all the way down. It’s just adding more context length and more layers and wider layers while training on more data. I personally think this approach will never achieve AGI or anything like it. It will get better at perfectly reciting its training data, but I don’t expect truly emergent phenomena to occur with these architectures just because they’re very big. They’ll be decent chatbots, but we already have that, and they’ll just consumer ever more resources for vanishingly small improvements (and won’t functionally improve any true logical capability beyond regurgitating logical paths already trodden in their training data but in a very brittle way, because they do not actually understand the logic or why the logic is valid, they have no true state model of objects which are described in the token space they’re traversing probabilistically).
- Comment on Nvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiece 1 day ago:
Sorry, I’m not saying that’s a good thing. It’s not just the context that’s expanding, but the parameter of the base model. I’m saying at some point you just have saved a compressed version of the majority of the content (we’re already kind of there) and you’d be able to decompress it even more losslessly. This doesn’t make it more useful for anything other than recreating copyrighted works.
- Comment on Nvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiece 2 days ago:
Current models are speculated at 700 billion parameters plus. At 32 bit precision (half float), that’s 2.8TB of RAM per model, or about 10 of these units. There are ways to lower it, but if you’re trying to run full precision (say for training) you’d use over 2x this, something like maybe 4x depending on how you store gradients and updates, and then running full precision I’d reckon at 32bit probably. Possible I suppose they train at 32bit but I’d be kind of surprised.
- Comment on Amazon BUSTED for Widespread Scheme to Inflate Prices Across the Economy— Amazon, its vendors, and competing retailers are price fixing, hiking up prices for consumer products 2 days ago:
Thank you! This is really good info. I’ll take a look!
- Comment on Amazon BUSTED for Widespread Scheme to Inflate Prices Across the Economy— Amazon, its vendors, and competing retailers are price fixing, hiking up prices for consumer products 2 days ago:
This is good to know. Can you provide a link to that court case or anything?
- Comment on Amazon BUSTED for Widespread Scheme to Inflate Prices Across the Economy— Amazon, its vendors, and competing retailers are price fixing, hiking up prices for consumer products 2 days ago:
Valve states you can’t sell a steam key in another platform for cheaper than in steam, not that you can’t sell your game anywhere else at a lower price. That’s slightly different than here. Not defending it just saying that it is actually different than here.
- Comment on You probably can't trust your password manager if it's compromised 1 week ago:
Looking through, it seems like for the most part these are very niche and/or require the user to be using SSO or enterprise recovery options and/or try to change and rotate keys or resync often. I think few people using this for personal would be interacting with that attack surface or accepting organizational invites, but it is serious for organizations (probably why they’re trying quickly to address this).
Honestly I think a server being incognito controlled and undetected in bitwardens fleet while also performing these attacks is, unlikely? Certainly less likely than passwords being stolen from individual site hacks or probably even banks. Like at that point, it would just be easier to do these types of manipulations directly on bank accounts or crypto wallets or email accounts than here, but then again, if you crack a wallet like this you get theoretically all the goodies to those too I suppose, for a possibly short time (assuming the user wasn’t using 2FA that wasn’t email based as well).
Not to mitigate these issues. They need to fix them, just trying to ascertain how severe and if individual users should have much cause for concern.
- Comment on Microsoft sets Copilot agents loose on your OneDrive files 3 weeks ago:
That won’t poison an LLM exactly.
www.anthropic.com/research/small-samples-poison#%….
Theoretically this is a place to start. They probably have mitigations for many of these.
- Comment on [deleted] 5 weeks ago:
I’ll look into this, but at first blush this is just mostly tool calling with RAG. This does not prevent a whole host of issues with AI, and doesn’t really prevent lying. The general premise here is to put tight guard rails on how it can interact with data, and in some cases entirely forcing a function / tool path with macros. I am not really sure this would work any better than just a stateful and traditional search algorithm on your own data sources, and would require much less hardware / battery / requirements and would be much more portable.
I like the effort, but this feels a bit like trying to make everything look like a nail.
- Comment on ICE is using online influencers, geo-targeting to recruit deportation agents 1 month ago:
I kinda hope some people join to sabotage from within
- Comment on PS5 ROM Keys Leaked: Sony’s Unpatchable Security Nightmare (2026) | The CyberSec Guru 1 month ago:
I think it is comparable. A ps5 is hardware. Sony is under no obligation to provide a 3rd party operating system, but they should also not restrict you from creating or deploying one yourself on the hardware you own. Fundamentally, this should also extend to running software from any vendor you choose (a third party App Store). Sony artificially restricts your choice to only buying from them, and only running firmware and software they distribute. This is not dissimilar from iOS or Android or other hardware vendors that lock you in and lock down your hardware.
- Comment on Leak confirms OpenAI is preparing ads on ChatGPT for public roll out 2 months ago:
You can get by surprisingly well on 20b parameter models using a Mac with decent ram or even 8b parameter models that fit on most high end (eg 16gb) model cards. Depends on your use cases but I almost exclusively use smaller local models.
- Comment on My review on the AYN Odin 3 2 months ago:
Things like this are why I seriously think the next steam deck may include an ARM based version. Possibly a smaller, lighter, more switch like device alongside something more like a z1e equivalent device.
Steam Frame may do a lot for VR but also for ARM gaming.
My secret hope though is risc-v also somehow gets on the map.
- Comment on GOP overhaul of broadband permit laws: Cities hate it, cable companies love it 3 months ago:
More like, large corporations not at all invested in local communities are now empowered to completely run rough shod over local governance processes. They’re actually more likely to pay for folks to stall out slow approval processes so that they can take advantage of this law and start building, especially when the permit would have likely been denied because it didn’t consider easements, fire or flood risks, building and local regulatory standards, or any other manner of things. So this actually increases the likelihood of bribes, and ensuring that corporations actually pay less to your local government and more to personal pockets of those being bribed.
A better version of these flawed tactics would’ve been that failure to meet timelines would open the project to public vote and also that every project would require a public option (eg government supplied bid on the infrastructure) to compete. That way if timeline expires, it’s not automatically awarded to people who have a vested interest in it expiring at the expense of a community. It could be awarded to a local municipal project instead.
- Comment on Tell us the truth Donny. 3 months ago:
I think everyone is also missing the very real possibility that this might not have been an adult male. I don’t think we should presume it was consensual, in part because I don’t think we can presume the individual was old enough to consent.
- Comment on Nearly 90% of Windows Games now run on Linux, latest data shows — as Windows 10 dies, gaming on Linux is more viable than ever 3 months ago:
I believe Destiny 2 also doesn’t work. I just don’t play it anymore lol
- Comment on Microsoft Pushes Xbox Division to Hit Higher Profit Margins 4 months ago:
Make it 12x the lowest paid by hourly rate. Then maybe it’s 32 hours, or less, but you’ll be paid no more than 12x less than the highest paid employee on an hourly basis.
Also, the hourly wage should include all compensation, including benefits and stock options, so they don’t try to stuff their benefit and stock packages (eg private plane and company car).
Also, tax all wealth above 20x the median wealth of the nearest 100,000 people at 90%.
- Comment on jotty·page - Checklists & Notes made it easy 4 months ago:
I think it’s okay, I made a comment about the license first! It’s good discussion. I certainly like everything being copyleft, but I also get why people who make a contribution (an extension or otherwise) might want to license it differently. Ultimately whoever does the work gets to decide on the license — closed source I’ll never touch, extension or otherwise, but I’m lenient on open source.
- Comment on jotty·page - Checklists & Notes made it easy 4 months ago:
Oh I’m fine with copyleft, even preferred. I just see any open source license, even MIT, and am pleased. Perhaps my bar is too low, but at this point anyone posting anything with open source protection to the creation is cool to me.
- Comment on jotty·page - Checklists & Notes made it easy 4 months ago:
Hey some folks responded here which is great! For me, I think wiki and tracker are perfect like someone else mentioned, because a lot of folks without accounts can still access the knowledge created. The hard part is moderating of course. I’m not sure there is a perfect solution.
Ultimately, you’re producing something cool for the community and you get to set the terms for that; if discord is easy and sustainable, I prefer that to you doing anything else that isn’t sustainable to see the project through as long and vibrantly as you can. So in that sense just choose what makes sense.
So in short: do what makes sense for you and if one of the alternatives listed (maybe wiki it seems? That would be cool with me) works then that’s great!
I guess I’ll also plug forgejo or codeberg at this time haha
- Comment on jotty·page - Checklists & Notes made it easy 4 months ago:
MIT license, cool! I’ll check this out. Any chance to migrate from discord to a more open platform for community engagement?
- Comment on Lumo: the least open 'open' AI assistant 5 months ago:
It supports the thesis that Lumo is not open source in many common sense ways that most people would expect when a model claims it is open source. So in that sense, it does though.
- Comment on Lumo: the least open 'open' AI assistant 5 months ago:
It supports the thesis that Lumo is not open source in many common sense ways that most people would expect when a model claims it is open source. So in that sense, it does though.
- Comment on Over 450 Diablo developers at Blizzard have unionized 5 months ago:
They’ll be required to pay their employees appropriately and provide benefits.
- Submitted 7 months ago to selfhosted@lemmy.world | 0 comments
- Comment on Bambu Lab Controversy Deepens: Firmware Update Sparks Backlash 8 months ago:
Prusa Core One. Can buy it prebuilt or as a kit.
Disclosure: I do not have one. I have a creality k1 and it’s mostly great for me, but it isn’t perfect and I personally would buy a prusa if I was buying a new printer.
- Comment on First time software set up help 8 months ago:
Amazing, thank you! I think I’m gonna have to be okay with not nailing it on the first go and trialing it out the next few days. Step one sounds like proxmox to me :)
- Comment on First time software set up help 8 months ago:
Hey man, thanks so much for the response, this is great! Love the idea of offloading ai workloads to their on vms to make facilitating managing resources easier.
Also, big thanks for the recommended software — very helpful list for me to look through, especially on the AI front. Do you have any notes on configuration for those in particular?
- Comment on First time software set up help 8 months ago:
Thanks for the reply!
My understanding was that with only 4 drives, raidz would lower read throughput and not add much space / redundancy. Is that not true? Would you mind giving me a few more details on how you’d set up a 4x8tb raidz array (or could point me to a tool / resource that could help me? I haven’t been able to fully convince myself either way)
- Submitted 8 months ago to selfhosted@lemmy.world | 10 comments