Comment on G-Assist is ‘real’: NVIDIA unveils NitroGen, open-source AI model that can play 1000+ games for you
JackbyDev@programming.dev 2 weeks agoSort of already exists as Baritone. github.com/cabaletta/baritone I’m not sure what all it can and can’t do but it’s pretty sophisticated.
Zos_Kia@lemmynsfw.com 2 weeks ago
Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It’s more of an automation framework, it’s a terrific piece of software but not “AI”.
I’ve dicked around with a baritone+LLM setup but it’s really hard to get the model to do anything worthwhile. The model doesn’t really see the world around it, just whatever textual representation you manage to make of it. It’s slow and frustrating and only gets the very basic tasks right.
I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I’d love to see a civilization of bots building its own base with mega farms and shit…
JackbyDev@programming.dev 2 weeks ago
Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually “AI” (not LLM AI but what we would’ve called AI pre LLM/gen AI lol). I don’t remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it’s much more involved than just clicking with a sword or aiming arrows.)
Zos_Kia@lemmynsfw.com 2 weeks ago
I totally missed that ! Thanks for the reference I’ll try to find it.
I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun.