Sorry I’m still not really sure what you’re asking for.

I use Open Web UI, which is the worst name ever, but it’s a web ui for interacting with chat format gen AI models.

You can install that locally and point it at any of the models hosted remotely by an inference provider.

So you host the UI but someone else is doing the GPU intensive “inference”.

There seems to be some models for t his task available on huggingface like this one:

huggingface.co/…/roberta-base-ai-text-detection-v…

The difficulty may be finding a model which is hosted by an inference provider. Most of the models available on huggingface are just the binary model which you can download and run locally. The popular ones are hosted by inference providers so you can just point a query at their API and get a response.

As an aside, it’s possible or likely that you know more about how Gen AI works than I do, but I think this type of “probability table for the next token” is from the earlier generations. Or, this type of probability inference might be a foundational concept, but there’s a lot more sophistication layered on top now. I genuinely don’t know. I’m super interested in these technologies but there’s a lot to learn.