Comment on LLM on Nintendo DS Lite
binaryqueen@programming.dev 17 hours agoThis is the model:
{ "data" : [ { "context_window" : 4096, "created" : 1719792000, "id" : "apple-foundationmodel", "notes" : "Apple on-device model via FoundationModels framework. Unsupported parameters are rejected with 400 when present (except n=1 and logprobs=false). Supported languages: it, zh, fr, en, nb, fr, da, es, es, es, vi, zh, de, pt, tr, en, zh, sv, nl, ja, en, ko, pt", "object" : "model", "owned_by" : "apple", "supported_parameters" : [ "temperature", "max_tokens", "seed", "stream", "tools", "tool_choice", "response_format", "x_context_strategy", "x_context_max_turns", "x_context_output_reserve" ], "unsupported_parameters" : [ "logprobs", "n", "stop", "presence_penalty", "frequency_penalty" ] } ], "object" : "list" }
and I’m running it on a MacBook Air M4 16 GB.
Do I understand correctly that what you’ve made is a DSLite client to chat with the apple included model on your laptop?
binaryqueen@programming.dev 16 hours ago
Exactly, yes.
That’s a really neat and fun project!
I have a back DSLite that I got the new OS cart for and I’ve been having fun loading it up with emulators and my favorite games from the past. I love how there is such a vibrant community around DSLite hacking.
You should certainly keep doing projects like this and sharing them. I’m glad you shared it because I love hacking projects. However for me this is not on topic for selfhosting even if it is still a very cool project.
binaryqueen@programming.dev 15 hours ago
Thank you so much, I appreciate your comments. It means a lot to me. :)
The only reason why I did this project was because someone showed up in my feed with a post about a DS Lite hack. We’re all inspiring each other haha :D