L_Acacia
@L_Acacia@lemmy.one
- Comment on Discord lowers free upload limit to 10MB: “Storage management is expensive” 3 weeks ago:
Revolt tries to be a discord clone/replacement and suffer from some of the same issues. Matrix happens to have a lot of feature in common, but is focused on privacy and security at its core.
- Comment on Proton mail launches LLM and crypto wallet 2 months ago:
Mistral modèles don’t have much filter don’t worry lmao
- Comment on Proton mail launches LLM and crypto wallet 2 months ago:
They is no chance they are the one training it. It costs hundreds of millions to get a descent model. Seems like they will be using mistral, who have scrapped pretty much 100% of the web to use as training data.
- Comment on [deleted] 2 months ago:
Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.
- Comment on [deleted] 2 months ago:
You are limited by bandwidth not compute with llm, so accelerator won’t change the interferance tp/s
- Comment on Leaked WhatsApp Feature Allows Users to Create Customized Stickers Using Their Own Image 2 months ago:
I use similar feature on discord quite extensively (custom emote/sticker) and i don’t feel they are just a novelty. Allows us to have inside joke / custom reaction to specific event and I really miss it when trying out open source alternatives.
- Comment on Apple could announce a Google Gemini deal this fall 2 months ago:
Too be fair to Gemini, even though it is worse than Claude and Gpt. The weird answer were caused by bad engineering and not by bad model training. They were forcing the incorporattion off the Google search results even though the base model would most likely have gotten it right.
- Comment on [deleted] 4 months ago:
Google uses their own chip for AI
- Comment on We have to stop ignoring AI’s hallucination problem 4 months ago:
They know the tech is not good enough, they just dont care and want to maximise profit.
- Comment on Apple won’t be forced to open up iMessage by EU 7 months ago:
Whatsapp is europe’s iMessage
- Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard 7 months ago:
You can take a look at exllama and llama.cpp source code on github if you want to see how it is implemented.
- Comment on OpenAI's GPT Trademark Request Has Been Denied 7 months ago:
If you have good enough hardware, this is a rabbithole you could explore. github.com/oobabooga/text-generation-webui/
- Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard 7 months ago:
Around 48gb of VRAM if you want to run it in 4bits
- Comment on Smaug-72B-v0.1: The New Open-Source LLM Roaring to the Top of the Leaderboard 7 months ago:
To run this model locally at gpt4 writing speed you need at least 2 x 3090 or 2 x 7900xtx. VRAM is the limiting factor in 99% of cases for interference. You could try a smaller model like mistral-instruct or SOLAR with your hardware though.
- Comment on [deleted] 7 months ago:
Those slowndown article were clickbait / bad journalism , youtube hasn’t been slowing down the site for adblock user.
- Comment on Why Linux is Best for Most People 8 months ago:
I put zorin on my parent’s computer 2 years ago, while its a great distro, their windows app support is just marketing, its an out of date wine version with an unmaintained launcher. Worse than tinkering with wine yourself.
- Comment on It's official: Evernote will restrict free users to 50 notes | TechCrunch 9 months ago:
It works with plugin juste like obsidian, so if their implémentation is not gold enough, you can always find a gramarly plugin.
- Comment on It's official: Evernote will restrict free users to 50 notes | TechCrunch 9 months ago:
It does not work exactly like obsidian as it is an outliner. I use both on the same vault and logseq is slower on larger vault.
- Comment on OpenAI suspends ByteDance’s account after it used GPT to train its own AI model. 9 months ago:
It works pretty well. You can create a good dataset for a fraction of the effort and price it would have required to do it by hand. The quality is similar. You just have to review each prompt so you don’t train your model on bad data.
- Comment on Stable Diffusion XL Turbo can generate AI images as fast as you can type 9 months ago:
Do you use comfyui ?
- Comment on Qualcomm brings receipts: Snapdragon X Elite gets benchmarked, completely dunks on Apple’s M2 processor 10 months ago:
Being able to run benchmarks doesn’t make it is a great experience to use unfortunately. 3/4 of applications don’t run or have bugs that the devs don’t want to fix.
- Comment on Qualcomm brings receipts: Snapdragon X Elite gets benchmarked, completely dunks on Apple’s M2 processor 10 months ago:
Windows is not fine with ARM, which can be a turnoff for some.
- Comment on People are speaking with ChatGPT for hours, bringing 2013’s Her closer to reality 11 months ago:
Llama models tuned for conversation are pretty good at conversation. ChatGPT also was before getting nerfed a million time.
- Comment on First automatic JPEG-XL cloud service 1 year ago:
JPEG-XL support is being tested in firefox nightly
- Comment on [deleted] 1 year ago:
They have a github where you can see all the changes that are being made. github.com/privacyguides/…/releases
- Comment on Beating GPT-4 on HumanEval with a Fine-Tuned CodeLlama-34B 1 year ago:
Llama 2 now uses a license that allows for commercial use.
- Comment on Beating GPT-4 on HumanEval with a Fine-Tuned CodeLlama-34B 1 year ago:
The best way to run Llama model locally is to run using Text generation web UI, the model will most likely be quantized to 4/5bit GGML / GPTQ today, which will make it possible to run on a “normal” computer.
Phind might make it accessible on their website soon, but it doesn’t seem to be the case yet.
- Comment on Why you shouldn't use Brave Browser 1 year ago:
the setting used for vivaldi on this test are worse than the default one, pretty bad source as the author tries to make brave look as good as possible
- Comment on Which privacy-focused search engine are you using? 1 year ago:
Duckduckgo results are pretty bad in my experience, brave search and startpage are way better.