Sims

@Sims@lemmy.ml

• ⁨Comment⁩ on ⁨Would you use a self-hosted, AI-powered search engine for your favorite sites?⁩ ⁨⁨4⁩ ⁨days⁩ ago⁩:

  Absolutely. I’m not as AI-phobic, and I absolutely need both an information gathering agent that searches, follows rss/channels, explores/researches topics, summarizes swats of daily events, and I need a filter between me and corporate internet. Let the AI discard obvious slop, Ads/other propaganda and general informational noise.

  However, you should think about how to share search-results so all our agents don’t floor small services/commoners. We really need to get more information out of corporate silo’s, and into public search/knowledge systems. Perhaps you can integrate some distributed search/knowledge properties ? (now that you have AI to help build it)

• ⁨Comment⁩ on ⁨How to use GPUs over multiple computers for local AI?⁩ ⁨⁨5⁩ ⁨days⁩ ago⁩:

  There are several solutions:

  github.com/b4rtaz/distributed-llama

  github.com/exo-explore/exo

  github.com/kalavai-net/kalavai-client

  petals.dev

  Didn’t try any of them and haven’t looked for 6 months, so maybe something better have arrived…