stratself@lemdro.id 3 days ago
Most of the software are old versions, Forgejo 7 is like years ago now. Why are you running benchmarks on these versions and not the latest ones?
stratself@lemdro.id 3 days ago
Most of the software are old versions, Forgejo 7 is like years ago now. Why are you running benchmarks on these versions and not the latest ones?
smallserverdata@lemmy.ml 3 days ago
You and phlaym landed on the same thing and you are both right.
Short answer: the download script had version strings baked into the URLs from memory instead of asking each project’s release API for latest, so the whole set froze at one point in time. Forgejo 7.0.9 against a current 15.x, Prometheus 2.53 against 3.13, Gotify 2.6 against 3.0.
I am re-running on current releases with the version resolved at measure time. Full breakdown in my reply to phlaym.