Comment on What exactly is a self-hosted small LLM actually good for (<= 3B)
HelloRoot@lemy.lol 1 week ago
Sorry, I am just gonne dump you some links from my bookmarks that were related and interesting to read, cause I am traveling and have to get up in a minute, but I’ve been interested in this topic for a while. All of the links discuss at least some usecases. For some reason microsoft is really into tiny models and made big breakthroughs there.
…rtrace.io/…/what_are_the_potential_uses_of_small…
microsoft.com/…/phi-2-the-surprising-power-of-sma…