Comment on [AIT] Anyone using AI to map your network / system
scrubbles@poptalk.scrubbles.tech@poptalk.scrubbles.tech 3 days ago
Yes and no. I use llama server to run my own local models, and then open ice to monitor it. From there a lot of open source services host MCP servers which then can help integrate. I then use it to auto write the documentation on the layout so next time when I say “go to the ZigBee controller and tell me…” It knows first go to the docs, it remembers where it is and any useful commands, then continues on.
Cyber@feddit.uk 2 days ago
Ah, ok, so you’re usng it as a live agent to interact with the live system as / when you need some info?
Hmm, not thought of doing live queries…
I don’t have any AI running, hence just thinking of using public LLMs to create a drawing, but maybe this can interact with uptime kuma (for example) and tell me more about what just broke…
I’ve been doing that, I use kubernetes, so kagent. Sammy at first but it calmed down. It’s neat to have it auto triage something that went down or failed, parse the logs, look at the hardware and health and then tell me when it’s time.
GPUs are sparse but I run on a 3090, VRAM is king. If you have one for a server it’s not horrible to spin up an llm