DarkThoughts
@DarkThoughts@kbin.social
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 8 months ago:
Yes, databases (saved on a hard drive). SillyTavern has Smart Context but that seems not that easy to install so I have no idea how well that actually works in practice yet.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 8 months ago:
I honestly have no idea what you're referring to now. I never asked for any ideas.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
I was being sarcastic. If you pay for a prostitute you might as well pay for an AI service such as novelai.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 9 months ago:
And I replied to that comment, without any mouth foaming.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 9 months ago:
If they're local they'd be basically useless due to a lack of computing power and potential lack of indexing for a search engine chatbot, so I doubt it. It would also have to be so polished that it wouldn't require further user knowledge / input, and that's just not a thing with any local LLM I've come across. Mozilla can gladly prove me wrong though. I certainly wouldn't mind if they generally can make the whole process of local LLMs easier and more viable.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 9 months ago:
Yes, but what would a local model do for you in this case? Chatbots in browsers are typically used as an alternative / more contextualized search engine. For that you need proper access to an index of search results. Most people will also not have enough computing power to make use of any complex chatbot / larger context sizes.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
Yeah, I heard they're also very privacy friendly.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
I don't know, I'm not a weeb.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 9 months ago:
All of those could be terrible to be honest, because AI is a data tracking vacuum. An AI adblocker or content filter sounds cool at first, but it would mean it reads and analyzes your data, just like the shit you do with chatbots too. Reading your mails? That's basically what Google does for years with gmail, that's why they have such a good spam filter. I agree that a chatbot would be kinda useless though, even if privacy friendly, which in of itself would be great but I just don't see the use. This could simply be outsourced to a website.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 9 months ago:
There's no way it would be running locally.
- Comment on Mozilla lays off 60 people, wants to build AI into Firefox 9 months ago:
The answers to both of those things depends very heavily on the details. I think focusing on their main products is a good thing, but adding AI sounds like one of those likely terrible decisions. We definitely need privacy friendly & open source based AI though, in all areas, so I hope this is Mozilla pushing for something sensible here.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don't have enough vram for that.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
See my other reply for some basic info & pointers.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
The bots (what the actual girlfriends or whatever other characters are) aren't the problem. You can find them on chub.ai for example or write them yourself fairly easily. The issue the software, and even more so the hardware. You need something like the mentioned Kobold.ccp or oobabooga, and then you'd also need a trained LLM model that you can get on huggingface.co, which is already where it gets complicated (they'll be loaded within kobold or oobabooga). You also need to understand how they work in regards to context sizes & bytes, because they need a lot, and I mean A LOT of vram to work properly. Basically, the more vram you have, the better the contextual understanding, their memory is. Otherwise you'd have a bot that maybe knows to only contextualize the last couple messages. For paid services like novelai.net you basically have your bots run through big ass server farms with lots of GPUs that bundle their vram and processing power, giving you "decent" context sizes (imo the greatest weak point of LLMs and it is deeply rooted in how they work) and decent speed. NovelAI also supports front-ends like SillyTavern which is great for local bot management and settings, regardless if you self host or use a paid service (NOT EVERY PAID SERVICE HAS AN API FOR THIS! OpenAI's ChatGPT technically does too but they do not allow NSFW content and can ban you for that if caught).
There's a bunch of "free" online services too, like janitorai.com but most of them have slow speeds and the chat degrades significantly after just a few messages, because they have low context sizes. The better / paid models suffer from this degradation too but it is slower and less noticeable, at least at first. You can use that to get an idea of how LLMs work though. - Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
I tried oobabooga and it basically always crashes when I try to generate anything, no matter what model I try. But honestly, as far as I can tell all the good models require absurd amounts of vram, much more than consumer cards have, so you'd need at least like a small gpu server farm to local host them reliably yourself. Unless of course you want like practically nonexistent context sizes.
- Comment on Your AI Girlfriend Is a Data-Harvesting Horror Show 9 months ago:
"AI" is funny anyway because you're basically gaslighting them the whole time to have them behave as they're supposed to.
- Comment on Games with graphics resembling PS1 or PS2? 10 months ago:
If you mean low poly & texture sized 3D games, then I would say BallisticNG, which is directly inspired by Wipeout from the original PSX. Also, while not quite the same, Valheim has a similar pixelated texture style with low poly models (for today's standards at least).
- Comment on How social media’s biggest user protest rocked Reddit 10 months ago:
A few tens of thousand of people. We can see that through the statistics of active monthly users since then. I think many just left Reddit though, but unfortunately not enough. But still, if I look at the content and comments through RedReader it feels all kinda different there. Even more reposts than before, much more bot comments than before, much less comments overall and /r/all just looks different because many previously big subs are not really there anymore, while a lot of more niche subs suddenly appear frequently. It sometimes also feels more toxic with al lthe disinfo and insults but that might just be because a lot of the moderate people left. So the lack of sane comments puts an extra highlight on the shit stains of Reddit.
- Comment on What If: No Social Media Anonymity 10 months ago:
Aside from the obvious privacy issues, which are definitely the main problems here, it isn't just users that behave differently. I've got several bans on Reddit that were literal bullshit, like saying a fascist Italy should be kicked out of NATO and the EU. Apparently this is "spreading hate", worthy of a permanent ban, despite the fact that both institutions require democratic foundations for their member states. Mods and admins are just as ridiculous, be it out of malice or simply incompetency. And once you're banned, there's nothing you can do. You can try to appeal but those are in almost all cases denied too.
But it also goes very much against the basic principles on what the internet was founded on. If we put some heavy identifiable restrictions onto internet accessibility then that's a very powerful tool of oppression. Maybe you trust you current government enough to handle that, right now. I personally don't. But even then, you never know what the next one will do. Tools of oppression like this, or AI based surveillance, could strangle any sort of meaningful resistance before it even gains the slightest bit of traction. Just look at how many far right governments had been gaining votes or even got into power over the last decade. Do you really trust those people to handle such tools with the needed responsibility?
- Comment on Scientists successfully replicate historic nuclear fusion breakthrough three times 10 months ago:
And the thorium bros are in the Fediverse now too... Great...
- Comment on Scientists successfully replicate historic nuclear fusion breakthrough three times 10 months ago:
Technically the same goes for fission, as new reactors take well over a decade to build nowadays, which is too late for our climate goals and typically diverts resources away from renewables.
- Comment on The Fediverse is working just as intended. 11 months ago:
Hexbear.
- Comment on Tesla removes Disney+ app amid Elon Musk's feud with Disney CEO Bob Iger 11 months ago:
Cancel culture.
- Comment on Supercomputer that simulates entire human brain will switch on in 2024 11 months ago:
Reminds me back in like the late 90s / early 2000s when we used those rainbow text color fader generator tools for chats and messaging apps. I remember there was a pretty popular one back then but I forgot the actual name.
Think of something like this but an actual PC app: https://patorjk.com/text-color-fader/
- Comment on Supercomputer that simulates entire human brain will switch on in 2024 11 months ago:
Definitely give it some anxiety.
- Comment on Supercomputer that simulates entire human brain will switch on in 2024 11 months ago:
Are you saying you're a Viltrumite?
- Comment on Built a new machine, the moment Unraid is running there are strange interference sounds coming from the back of the machine. 11 months ago:
Sounds like coil whining to me too, albeit a pretty loud one. It's typically GPUs and / or PSUs that are the culprit when they're under load.
- Comment on Mozilla announces their new AI website builder, community reacts appropriately 11 months ago:
You don't have to spam me by deleting and lazily reposting your comment.
- Comment on Mozilla announces their new AI website builder, community reacts appropriately 11 months ago:
Unless they were also scared about WYSIWYG editors 25+ years ago.
I guess even web developers can be stupid. ¯\_(ツ)_/¯
- Comment on Mozilla announces their new AI website builder, community reacts appropriately 11 months ago:
Those are stupid and I doubt any web developer wrote these. Unless they were also scared about WYSIWYG editors 25+ years ago.