Comment - FBXL Lotide

binaryqueen@programming.dev ⁨1⁩ ⁨day⁩ ago

I use the Kaico DSpico Flashcart and on the RPi Zero 2W I use a bash script with hostapd, iw, dnsmasq, socat, and iproute2. For HTTP and JSON I use my own implementation, no library. The rest is documented in the post.

Did some experiments with my DS Lite and ended up with this. Using DevkitPro libs (libnds, dswifi, calico). Apfel on macOS and a wifi (WEP) bridge running on a RPi Zero 2W. 🖤

original

Sort:hotnew top

CallMeAl@piefed.zip ⁨17⁩ ⁨hours⁩ ago

Which LLM are you running and what are you running it on?

original

binaryqueen@programming.dev ⁨17⁩ ⁨hours⁩ ago

This is the model:

{
  "data" : [
    {
      "context_window" : 4096,
      "created" : 1719792000,
      "id" : "apple-foundationmodel",
      "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
      "object" : "model",
      "owned_by" : "apple",
      "supported_parameters" : [
        "temperature",
        "max_tokens",
        "seed",
        "stream",
        "tools",
        "tool_choice",
        "response_format",
        "x_context_strategy",
        "x_context_max_turns",
        "x_context_output_reserve"
      ],
      "unsupported_parameters" : [
        "logprobs",
        "n",
        "stop",
        "presence_penalty",
        "frequency_penalty"
      ]
    }
  ],
  "object" : "list"
}

and I’m running it on a MacBook Air M4 16 GB.

original

CallMeAl@piefed.zip ⁨17⁩ ⁨hours⁩ ago
Do I understand correctly that what you’ve made is a DSLite client to chat with the apple included model on your laptop?

original
- binaryqueen@programming.dev ⁨16⁩ ⁨hours⁩ ago
  Exactly, yes.
  
  original
  - -> View More Comments