Comment on LLM on Nintendo DS Lite

• CallMeAl@piefed.zip ⁨1⁩ ⁨day⁩ ago

  Please share the full stack with us

  original

  • binaryqueen@programming.dev ⁨1⁩ ⁨day⁩ ago

    I use the Kaico DSpico Flashcart and on the RPi Zero 2W I use a bash script with hostapd, iw, dnsmasq, socat, and iproute2. For HTTP and JSON I use my own implementation, no library. The rest is documented in the post.

    Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤

    original

    • CallMeAl@piefed.zip ⁨17⁩ ⁨hours⁩ ago

      Which LLM are you running and what are you running it on?

      original

      • binaryqueen@programming.dev ⁨17⁩ ⁨hours⁩ ago

        This is the model:

        {
          "data" : [
            {
              "context_window" : 4096,
              "created" : 1719792000,
              "id" : "apple-foundationmodel",
              "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
              "object" : "model",
              "owned_by" : "apple",
              "supported_parameters" : [
                "temperature",
                "max_tokens",
                "seed",
                "stream",
                "tools",
                "tool_choice",
                "response_format",
                "x_context_strategy",
                "x_context_max_turns",
                "x_context_output_reserve"
              ],
              "unsupported_parameters" : [
                "logprobs",
                "n",
                "stop",
                "presence_penalty",
                "frequency_penalty"
              ]
            }
          ],
          "object" : "list"
        }
        

        and I’m running it on a MacBook Air M4 16 GB.

        original

        • -> View More Comments