Comment - FBXL Lotide

Comment on LLM on Nintendo DS Lite

<- View Parent

binaryqueen@programming.dev ⁨3⁩ ⁨weeks⁩ ago

all of it. I’m not using anything outside of my own local area network.

original

Sort:hotnew top

CallMeAl@piefed.zip ⁨3⁩ ⁨weeks⁩ ago

Please share the full stack with us

original

binaryqueen@programming.dev ⁨3⁩ ⁨weeks⁩ ago

I use the Kaico DSpico Flashcart and on the RPi Zero 2W I use a bash script with hostapd, iw, dnsmasq, socat, and iproute2. For HTTP and JSON I use my own implementation, no library. The rest is documented in the post.

Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤

original

CallMeAl@piefed.zip ⁨3⁩ ⁨weeks⁩ ago

Which LLM are you running and what are you running it on?

original

binaryqueen@programming.dev ⁨3⁩ ⁨weeks⁩ ago

This is the model:

{
  "data" : [
    {
      "context_window" : 4096,
      "created" : 1719792000,
      "id" : "apple-foundationmodel",
      "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
      "object" : "model",
      "owned_by" : "apple",
      "supported_parameters" : [
        "temperature",
        "max_tokens",
        "seed",
        "stream",
        "tools",
        "tool_choice",
        "response_format",
        "x_context_strategy",
        "x_context_max_turns",
        "x_context_output_reserve"
      ],
      "unsupported_parameters" : [
        "logprobs",
        "n",
        "stop",
        "presence_penalty",
        "frequency_penalty"
      ]
    }
  ],
  "object" : "list"
}

and I’m running it on a MacBook Air M4 16 GB.

original

-> View More Comments