Comment on LLM on Nintendo DS Lite

CallMeAl@piefed.zip ⁨1⁩ ⁨month⁩ ago

• binaryqueen@programming.dev ⁨1⁩ ⁨month⁩ ago

  This is the model:

  {
    "data" : [
      {
        "context_window" : 4096,
        "created" : 1719792000,
        "id" : "apple-foundationmodel",
        "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt",
        "object" : "model",
        "owned_by" : "apple",
        "supported_parameters" : [
          "temperature",
          "max_tokens",
          "seed",
          "stream",
          "tools",
          "tool_choice",
          "response_format",
          "x_context_strategy",
          "x_context_max_turns",
          "x_context_output_reserve"
        ],
        "unsupported_parameters" : [
          "logprobs",
          "n",
          "stop",
          "presence_penalty",
          "frequency_penalty"
        ]
      }
    ],
    "object" : "list"
  }
  

  and I’m running it on a MacBook Air M4 16 GB.

  original

  • CallMeAl@piefed.zip ⁨1⁩ ⁨month⁩ ago

    Do I understand correctly that what you’ve made is a DSLite client to chat with the apple included model on your laptop?

    original

    • binaryqueen@programming.dev ⁨1⁩ ⁨month⁩ ago

      Exactly, yes.

      original

      • CallMeAl@piefed.zip ⁨1⁩ ⁨month⁩ ago

        That’s a really neat and fun project!

        I have a back DSLite that I got the new OS cart for and I’ve been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking.

        You should certainly keep doing projects like this and sharing them. I’m glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project.

        original

        • -> View More Comments