Submitted 3 weeks ago by xelar@lemmy.ml to selfhosted@lemmy.world
https://xeiaso.net/talks/2025/surreal-joy-homelab/
Remember that if you get an idea, fuck around, find out, and write down what you’ve learned: you’ve literally just done science. Well, with computers, so it’d be computer science, but you get my point.
Honestly it’s never been easier to start doing things, and doing things is very fun. Good advice!
Also, how is the author using 1password for credentials on server? They have service accounts now, but is there a better way than just always providing a credential when asked?
What makes this worse is that git servers are the most pathologically vulnerable to the onslaught of doom from modern internet scrapers because remember, they click on every link on every page.
The especially disappointing thing is that, for the specific case that Xe was running into, a better-written scraper could just recognize that this is a public git repository and just git clone the thing. Like, it’s not even “this scraper is scraping data that I don’t want it to have”, but “this scraper is too dumb to just scrape the thing efficiently and is blowing both the scraper’s resources and the server’s resources downloading innumerable redundant copies of the data”.
It’s probably just as well, since the protection is relevant for other websites, and he probably wouldn’t have done it if he hadn’t been getting his git repo hammered, but…
Sorta like how people complain about bots scraping Lemmy, even though federation already exists as a standardized protocol for distributing data. Like any scraper who wanted to efficiently scrape Lemmy would just spin up their own instance and let federation do the scraping for them. It would even have the added benefit that they could set their server to ignore delete requests, so deleted posts/comments wouldn’t get automatically removed from their server. And then they could scrape as much as they wanted without impacting anyone else.
But they don’t want to do that, because it would require the smallest modicum of forethought. They don’t care that scrapers are trashing the Internet and causing massive bandwidth issues for hosters. They just want the data, and they want it now. All of those “bots are flooding my server and eating all my bandwidth, so legitimate users can’t actually access the site” complaints are for other people.
I bet that if someone went to The Internet Archive, they could pay them to get timestamped snapshots of professionally-spidered stuff at zero load to the websites. I’m sure that it’d cost something for all the hard drives and probably something for labor, but so does spidering the whole Internet yourself.
looks at slides
I see where the anime catgirl logo that Anubis uses came from.
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
| Fewer Letters | More Letters |
|---|---|
| Git | Popular version control system, primarily for code |
| NAS | Network-Attached Storage |
| NVMe | Non-Volatile Memory Express interface for mass storage |
[Thread #163 for this comm, first seen 14th Mar 2026, 04:40] [FAQ] [Full list] [Contact] [Source code]
Xe Iaso my beloved
For those who don’t know, she created Anubis, but she was already writing cool articles before that, definitely recommend add her to your RSS Reader!
I’m sorry, but this was too difficult to read, the author is kinda cringe.
“Please laugh”
Meant to be a watched talk though, not an article – some of the original tone is prpbably missing in the transcript.
panda_abyss@lemmy.ca 3 weeks ago
I am glad I bought 128gb of ram last year.
FlordaMan@lemmy.world 3 weeks ago
I am angry at myself for delaying the purchases of a mini PC about 4 months ago /:
panda_abyss@lemmy.ca 3 weeks ago
If you buy now you can still brag about missing the next price increase when South Korea runs out of helium for chip production in 2 weeks.
Pulsar@lemmy.world 3 weeks ago
Me too, I was waiting for a good deal in a GMKtec EVO-X2, but that is not going to happen.
amgine@lemmy.world 3 weeks ago
I have 1.5tb of ecc ddr4 and don’t know what to do with it. Work decom’d a bunch of servers and I took ram and storage
Breezy@sopuli.xyz 2 weeks ago
Use them as a form of currency at this point lol
Breezy@sopuli.xyz 2 weeks ago
And here I thought $399 for a 4TB Samsung NVMe 990 Pro was a bit too expensive. Little did I know. I’m so glad my friend talked me into impulse purchasing it last year. What I’m more annoyed about is not picking up HDDs for my NAS last year, I refuse to pay NVMe prices for HDDs.
KyuubiNoKitsune@lemmy.blahaj.zone 2 weeks ago
Wouldn’t it have been cheaper to buy a few smaller ones and a PCIe card?
panda_abyss@lemmy.ca 2 weeks ago
Same, I wish I’d bought two.
Zos_Kia@jlai.lu 2 weeks ago
Serious question, what does RAM help with in the context of self hosting? I recently bought 32G for my server, and it’s DDR3 ecc so it’s so cheap I could have afforded 64 but I just kept wondering what will I use it for? I rarely go north of 6G usage and that’s with half a dozen services, a Minecraft server etc… I just don’t know what kind of services are RAM hungry.
fuckwit_mcbumcrumble@lemmy.dbzer0.com 2 weeks ago
VMs mostly. What are you hosting on Minecraft that isn’t using >=4 gigs?
Also ZFS.
vodka@feddit.org 2 weeks ago
My use case might not be very relatable, but I run a bunch of stuff cached in ramdisk.
One example is if my jellyfin server has to transcode something, I have it use ramdisk instead of my SSD for the transcoding cache.
panda_abyss@lemmy.ca 2 weeks ago
Probably not a lot.
My system idles at 3gb.
But then I do AI stuff and it needs 15-80gb. And I do data analyses that can use a lot.
Bakkoda@lemmy.world 2 weeks ago
I bought 3 kits of ddr5 last January before i realized the approved vendor list actually mattered (I’ve never had this happen before). I was too lazy to return them at the time because you can never have too much memory laying around.
KairuByte@lemmy.dbzer0.com 2 weeks ago
I have to ask… are you sure it matters? Last time I had this happen the mobo was trying to use extremely incorrect settings by default and causing the ram to be extremely unstable. I had to enable xmp and manually put in the correct settings.