hendrik
@hendrik@palaver.p3x.de
- Comment on How to Setup Camera Live Stream to my Server 1 day ago:
Maybe something like https://owncast.online/ or https://github.com/bluenviron/mediamtx
You could set it upp to record and maybe even use a hook and some cli signal client to send a message with the stream url to one of your friends?
- Comment on Please ELI5 the arguments people use to claim it's possible to use AI/LLMs ethically, locally, openly etc. 1 week ago:
Sure. Though I kinda struggle with those kinds of arguments. Because the Chinese definitely think this kind of theft is alright. And the Americans are a-okay with any kind of ripoff, as long as it’s big nasty companies doing it.
- Comment on Please ELI5 the arguments people use to claim it's possible to use AI/LLMs ethically, locally, openly etc. 1 week ago:
It’s big US companies like Meta (who own Facebook, WhatsApp etc), Google, Chinese companies like DeepSeek, Alibaba… Some other various startups and AI companies or spinoffs. And the occasional university or research institute. There’s a select few European ones. And Nvidia (who sell the graphics cards and hardware), they do research and publish stuff as well.
I think “open-weights” has been coined because the companies will mislead people and advertise with “open-source”, as in open-source software (like Linux, Firefox etc). But their models rarely include the sources (so to speak). That’d be the training recipe and all the data that went in. They can’t publish the training data though, because they regularly get sued by the people they stole the books from. So… they only publish the resulting AI model.
It’s a bit like an executable file on a computer or a purchased game which you can run at your own terms, on your computer, without any online stuff or anticheat attached. You just don’t own any of the development resources.
That means we don’t know what went in, we can’t recreate it, and we might not be able to learn a lot. We can however run and use the model. (We can even modify it to some degree.)
Of course that’s too easy. It’s not really an executable file. Those AI models are neural networks. All the information and “knowledge” is stored in the parameters of that network. That’d be the weights. Lots of numbers for all the nodes and edges which make up the graph/network.
And not sure about the inferior/superior models… I mean it’s hard to compete with OpenAI or Anthropic and the huge pile of money they have. They hired a lot of talent… And their results will be a trade secret, only offered as a service… But then there’s this whole AI war going on between the US and China. And all the companies against each other. They’re constantly trying to outcompete each other. And usually it won’t take long until someone claims they made an open-weights model as good as (or better than) the current version of ChatGPT.
- Comment on Please ELI5 the arguments people use to claim it's possible to use AI/LLMs ethically, locally, openly etc. 1 week ago:
And I can give numbers for people without a graphics card as well. I’m not a gamer so I didn’t bother buying a GPU. It takes my computer 20-40 minutes to generate a single image. Trying to generate video will make Linux step in and kill the process with an Out of Memory error. Generating text works. It’ll “write” a bit slower than I can read. And it takes additional time upfront to ingest my question.
- Comment on Please ELI5 the arguments people use to claim it's possible to use AI/LLMs ethically, locally, openly etc. 1 week ago:
Yes. “open-weights” means they publish the AI model file to the public and people can download and run it themselves.
And there’s very different AI models out there. Some are smaller, some bigger… Bigger usually means more “intelligent” and you also need more resources to run them. On average, if you own something like a beefy gaming computer, you can do a reasonably “clever” AI at reasonable speed. Something like ChatGPT needs a datacenter, and at the other end we also have some small models which run on some smartphones or average laptops. They surely won’t be able to do the same things ChatGPT does… And if your laptop is slow, it’ll output text very slowly. But maybe you’re okay with less “intelligent” AI.
And no, they don’t come from nowhere. They’re mainly made by the AI companies. They’re trained the same way all large language models are trained with the same problematic procedure. Oftentimes they publish some more information like a scientific paper alongside. There might be information inside about the energy used / carbon footprint of the training steps. Sometimes/rarely they also give information on what data they used.
And internet people have all sorts of weird opinions on (FOSS) philosophy and ethics. I think we’d need to be more specific than that. Dirty gas turbines and allowing companies to be exempt from copyright while other people get sued for copying a single movie isn’t really ethical by any means.
- Comment on Can't access some services behind reverse proxy 1 week ago:
I’d say there’s likely something wrong with your service. Maybe it refuses serving on a domain it’s not configured for? Or there’s something wrong with the headers or something like that. Or the internal network. Anyway, the 502 error is sent by the Caddy server. That means everything from your browser to the Caddy server should be fine. You can reach it. There’s something wrong with the service or the parts in-between the reverse proxy and the application.
- Comment on from the information i've seen, if you're waiting to buy a computer, do it soon. prices are going to skyrocket in 2027 and 2028. especially ram. 1 week ago:
Yeah, they probably bought 2 RAM sticks and think they can now manipulate markets with a Lemmy post and turn it into a great investment.
- Comment on How Many Users Can a 1 vCPU / 2 GB RAM Server Actually Handle? 1 week ago:
Yes, no shit Sherlock. Also why does the entire text read like it’s written by ChatGPT? Is it? Or did other AI service adopt this style of writing as well?
- Comment on How Many Users Can a 1 vCPU / 2 GB RAM Server Actually Handle? 1 week ago:
Make sure to tell us what was written, drawn or calculated by an AI.
- Comment on Phishing / spam detection with local LLMs? 2 weeks ago:
Though it’s kind of written by a black box 😂 I mean it’ll generate a reason. But ultimately it remains a mystery why LLMs conclude what they do. You can probably use it to improve the prompt and comppare models.
- Comment on Would you say, it is worth it to pay for a VPS for Pangolin? Hey, 2 weeks ago:
Maybe as another option, you could find a few other students and pool your money? I used to share an internet connection with several people to make it more affordable.
- Comment on Phishing / spam detection with local LLMs? 2 weeks ago:
RSpamd can add the reasoning to the mail in a header.
- Comment on Phishing / spam detection with local LLMs? 2 weeks ago:
LLM plugins should be available in standard spamfilters like Rspamd. Some mail servers like Stalwart haave it as well.
Not sure if it’s in the Email clients as well. I found a few Thunderbird addons, but that was just a quick Google search.
- Comment on What do you think of the relentless push to go digital? 2 weeks ago:
I don’t think “digital” is the issue. Main difference is how we’ve transitioned from owning stuff to renting everything as a service. With all its ups and downs. You can’t lend it to your friend, at some point there’s going to be licensing issues and you can’t re-watch or listen something anymore, it’s just gone. Occasionally there will be hiccups. Everything is jam-packed with spying, advertisement/manipulation and restrictions.
Digital on its own is kinda nice?! I like e-readers, mp3-players, the comfort of email compared to hand-writing a letter and then not having the correct amount of postage at home. I replaced the cassette deck in the car with a digital radio a long time ago. And now I don’t need to bring any 12 volume audiobooks anymore. That’s all very nice and convenient in the right way.
- Comment on What are your ideas for public holidays that can be celebrated by everybody? 2 weeks ago:
Some of the geek holidays. Like: Pi Day, Towel Day, Talk like a Pirate Day…
Also, bring your kids (of any gender) to work day… Though you’d obviously need to come in to work for that one. But there will be a tour and cookies!
- Comment on How does one solder a condensator ? 2 weeks ago:
There’s some YouTube videos on how to solder… For example this one looks like the capacitor has been harvested and super short leads: https://youtube.com/watch?v=iDtXq21bKYg
- Comment on is K2 horizons historically significant as the first actual open-source LLM, or am I falling for hype? 3 weeks ago:
Just to add a reference time frame: late 2022 was when ChatGPT got released. I think all these models predate the general population even being aware of AI.
- Comment on How is the modern Virtual Reality experience? 4 weeks ago:
The modern VR experience is, we have SteamOS run on the headset, so it doesn’t even need to be connected to any Linux computer. I think it’s quite pricey, though. And not sure if waiting is going to help with that.
- Comment on [Meta] Why do multiple accounts keep trying to post "We need a list of privacy-r 4 weeks ago:
Difficult to tell. We have bots. We also have people who think it’s some kind of service to the users to shove around re-posts of content… Always a bit suspicious if it’s new accounts created just for that one thing.
- Comment on We need a list of products we can buy without worrying about telemetry or advertising. 4 weeks ago:
Bummer. The commuter trains here run on electric. And they’re kinda privacy friendly if you got the right ticket. But then they’re late all the time, or don’t arrive at all. And they only get me to fixed locations…
- Comment on We need a list of products we can buy without worrying about telemetry or advertising. 4 weeks ago:
Nice! Though I struggle a bit with the number of available cars. 50 per entire earth isn’t much. And the range doesn’t seem great either. No clue what 35 miles is, but it doesn’t sound a lot…
- Comment on We need a list of products we can buy without worrying about telemetry or advertising. 4 weeks ago:
Uh. What’s with people who need a new car? Are they F-ed?
- Comment on Is Authelia enough without fail2ban or crowdsec? 4 weeks ago:
Guess if it works, you don’t really need fail2ban as f2b pretty much does the same job. I mean it can do more, but you don’t really need to protect against PHP issues, broken wordpress plugins etc since none of that is part of Authelia.
I use fail2ban, but I have SSH running and several other services exposed which come with default fail2ban configurations. And I never git crowdsec running. I think frequent updates and all those things are more important than a web application firewall anyway.
- Comment on Is Authelia enough without fail2ban or crowdsec? 4 weeks ago:
Authelia should come with rate limiting to protect against brute-force attacks. That could be enough.
I’d generally advise to make sure such protection actually works. Like look up the limits and try to login with a wrong password 30 times… Especially if you added stuff on top (fail2ban, crowdsec…) has happened to me I misconfigured stuff and it didn’t limit anything… Now I check to make sure for important bits like an authentication service.
- Comment on Is Openstreetmap unusable in some places? And very usable in others? 4 weeks ago:
No clue. Here in Germany it’s just fine. I’ve been using OSM data forever and it regularly gets me where I need to go. Also like the bicycle routes. Routing isn’t perfect with those, but close enough, considering the proprietary apps aren’t perfect either. And with OSM you also get people’s favorite illegal mountain bike tracks and all those awesome details.
Only issue I’m having is all the construction work and traffic jams these days, so you really want some live traffic data while navigating the car across cities.
- Comment on What sort of setup would you have for secure file storage on a VPS? 4 weeks ago:
I think a lot of backup programs offer encrypted backups. You enable that and it gets encrypted befor being transferred to the remote machine.
- Comment on [Question] Public-facing Wiki 4 weeks ago:
I’m sorry. For some reason we’re completely talking past each other… Your harddisk/ssd/usb-stick is a document based database afaik. You store data in form of files/documents on your HDD. It’s a bit like a library, yes. Those documents are organzed a certain way. In folders… maybe on shelves or whatever the digital equivalent is… The important parts of a wiki (the articles) are organized exactly the same way. That’s why DokuWiki manages to pull it off without a relational database. It really doesn’t matter for something like an encyclopedia or knowledge database. Can be articles in a books sitting on shelves in some building. Or digital files on a server, organized by a very similar hierarchy / topics.
- Comment on [Question] Public-facing Wiki 4 weeks ago:
I’m not convinced it is, that’s why I’m asking. Doesn’t really sound like it. Though I think it misses the point we were talking about, and is kinda verbose while talking about not really related points… Could be someone talking the way I do, or an AI, I can’t tell.
- Comment on [Question] Public-facing Wiki 4 weeks ago:
Is this AI text? If this is AI text: Nevermind. If no: I guess we’re not really on the same page. I didn’t say relational database. I mean it’s obviously not. It’s a document-oriented one. Which is exactly the kind of database you need when processing …well… documents. If you do additional web application mumbo jumbo, you might need a relational database. But this wasn’t really about any of this. We were talking of how expensive document retrievals are…
- Comment on [Question] Public-facing Wiki 4 weeks ago:
DokuWiki is great. Also very easy, straightforward and has a nice plugin ecosystem.
I guess the point about databases isn’t the entire story, though. The filesystem is a database as well. Doesn’t really matter whether you pull a database look up the article and return it, or have the filesystem find the file by it’s directories and name and return the data. That’s the same thing.