hikaru755

@hikaru755@lemmy.world

• ⁨Comment⁩ on ⁨Anthropic has developed an AI 'brain scanner' to understand how LLMs work and it turns out the reason why chatbots are terrible at simple math and hallucinate is weirder than you thought⁩ ⁨⁨5⁩ ⁨days⁩ ago⁩:

  “The planning thing in poems blew me away,” says Batson. “Instead of at the very last minute trying to make the rhyme make sense, it knows where it’s going.”

  How is this surprising, like, at all? LLMs predict only a single token at a time for their output, but to get the best results, of course it makes absolute sense to internally think ahead, come up with the full sentence you’re gonna say, and then just output the next token necessary to continue that sentence. It’s going to re-do that process for every single token which wastes a lot of energy, but for the quality of the results this is the best approach you can take, and that’s something I felt was kinda obvious these models must be doing on one level or another.

  I’d be interested to see if there are massive potentials for efficiency improvements by making the model able to access and reuse the “thinking” they have already done for previous tokens

• ⁨Comment⁩ on ⁨Plex is locking remote streaming behind a subscription in April⁩ ⁨⁨3⁩ ⁨weeks⁩ ago⁩:

  Huh? I’m streaming from my Jellyfin just fine when I’m on the go, with no tailscale or other VPN set up

• ⁨Comment⁩ on ⁨Apps doing year wrapped gives you a hint on how are you being tracked. There is probably a legal issue there somewhere like data retention.⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  not a common feature in proprietary software

  Just so you know, the GDPR mandates that you can at any time get a full export of all your personal data from anyone who’s processing it in a common, machine readable format. It is laudable though to have that integrated as a feature in the software, rather than jumping through hoops contacting support etc.

• ⁨Comment⁩ on ⁨Yo, Duplo, what you doing on the 24th?⁩ ⁨⁨3⁩ ⁨months⁩ ago⁩:

  Except there are competitors by now with equally good tolerances and overall part quality that still cost half as much, so that can’t really be the reason

• ⁨Comment⁩ on ⁨Wednesday it is, my dudes.⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  Oh that would also make sense, yeah

• ⁨Comment⁩ on ⁨Wednesday it is, my dudes.⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  I suspect that’s deliberate to make someone that speaks English and doesn’t know German still get the correct impression of what it actually sounds like, rather than get the spelling right

• ⁨Comment⁩ on ⁨Microsoft’s more secure Windows Recall feature can also be uninstalled by users⁩ ⁨⁨6⁩ ⁨months⁩ ago⁩:

  Reading the article, it seems like it will actually be opt-in for everyone