Comment on LLM on Nintendo DS Lite

CallMeAl@piefed.zip ⁨3⁩ ⁨weeks⁩ ago

• binaryqueen@programming.dev ⁨3⁩ ⁨weeks⁩ ago

  I use the Kaico DSpico Flashcart and on the RPi Zero 2W I use a bash script with hostapd, iw, dnsmasq, socat, and iproute2. For HTTP and JSON I use my own implementation, no library. The rest is documented in the post.

  Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤

  original

  • CallMeAl@piefed.zip ⁨3⁩ ⁨weeks⁩ ago

    Which LLM are you running and what are you running it on?

    original

    • binaryqueen@programming.dev ⁨3⁩ ⁨weeks⁩ ago

      This is the model:

      {
        "data" : [
          {
            "context_window" : 4096,
            "created" : 1719792000,
            "id" : "apple-foundationmodel",
            "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
            "object" : "model",
            "owned_by" : "apple",
            "supported_parameters" : [
              "temperature",
              "max_tokens",
              "seed",
              "stream",
              "tools",
              "tool_choice",
              "response_format",
              "x_context_strategy",
              "x_context_max_turns",
              "x_context_output_reserve"
            ],
            "unsupported_parameters" : [
              "logprobs",
              "n",
              "stop",
              "presence_penalty",
              "frequency_penalty"
            ]
          }
        ],
        "object" : "list"
      }
      

      and I’m running it on a MacBook Air M4 16 GB.

      original

      • CallMeAl@piefed.zip ⁨3⁩ ⁨weeks⁩ ago

        Do I understand correctly that what you’ve made is a DSLite client to chat with the apple included model on your laptop?

        original

        • -> View More Comments