I am not sure what the user above is thinking, but to play devil’s advocate:
One thing that modern AI does well is pattern recognition. An AI trained on player behavior, from beginner level all the way up to professional play, would be able to acquire a thorough understanding of what human performance looks like (which is something that games have been developing for a long time now, to try to have bots more accurately simulate player behavior).
I remember someone setting up their own litmus test using cheats in Tarkov where their main goal was just to observe the patterns of other players who are cheating. There are a lot of tells, a big one being reacting to other players who are obscured by walls. Another one could be the way in which aimbots immediately snap and lock on to headshots.
It could be possible to implement a system designed to flag players whose behavior is seen as too unlike normal humans, maybe cross-referencing with other metadata (account age/region/sudden performance anomalies/etc) to make a more educated determination about whether or not someone is likely cheating, without having to go into kernel-level spying or other privacy-invasive methods.
But then…this method runs the risk of eventually being outmatched by the model facilitating it: an AI trained on professional human behavior that can accurately simulate human input and behave like a high performing player, without requiring the same tools a human needs to cheat.
zqps@sh.itjust.works 14 hours ago
Cheating humans already perform closely enough to trick such a system. Many cheaters are smart enough to use an aimbot only for a split-second to nail the flick. With a tiny bit of random offset, those inputs indistinguishable from a high-skill player.
ChairmanMeow@programming.dev 13 hours ago
These tricks may make it indistinguishable to a human moderator, but machine learning is actually really good at detecting that. But most companies don’t have the expertise, resources or training data to build a proper model for it.
NuXCOM_90Percent@lemmy.zip 12 hours ago
Machine Learning is really good at CLAIMING it detected that.
The reality is that every few months there is a story about a fairly big streamer/e-sports player MAYBE getting caught cheating on stream. Sometimes it is obvious and sometimes it really becomes “Did they just know the map well enough to expect someone to come around that corner?”.
And a lot of times… it really is inconclusive. A somewhat common trope in movies is the veteran gunslinger literally aims at the wall of a stairwell and tracks where they expect the head to be and either fires a few rounds through the wall or waits for them at the bottom and… that is not entirely inconceivable considering that people tend to not crouch or move erratically down stairs. Obviously Jonathan Banks has a wallhack but Mike Ehrmantraut is just that damned good.
And false positives are a great way to basically kill a game. ESPECIALLY if they are associated with demonstrably false negatives too.
But you can be damned sure most of the major esports games are already doing this. It really isn’t expensive to train and they have direct feeds of every player in a tournament or twitch event. The issue is that there are (hopefully) tens of thousands of servers active at any moment and running Computer Vision+Inference on every single server is very costly.
And… I seem to recall there was a recent intentionally poorly defined Movement about maybe keeping user hostable dedicated servers a thing? How does that mesh with having every single server need to phone hom (a fraction of) all 32 players feeds to a centralized cluster?
ChairmanMeow@programming.dev 10 hours ago
Machine learning doesn’t necessarily require a centralized cluster. Usually running those kinds of models is pretty cheap, it’s not an LLM basically. They usually do better than human moderators as well, able to pick up on very minute ‘tells’ these cheats have.
I understand your point about edge cases, but that’s not something the average player cares about much. E-sports is a pretty niche part of any game, especially the higher ranks. You just want to filter out the hackers shooting everyone each game that truly ruin the enjoyment. Someone cheating to rank gold instead of silver or whatever isn’t ruining game experiences; they’re usually detectable too, but if you get a false negative on that it’s not the end of the world. A smurf account of a very highly ranked player probably has a bigger impact on players’ enjoyment.