Llama 3.1 is Meta's latest salvo in the battle for AI dominance

Submitted ⁨⁨3⁩ ⁨months⁩ ago⁩ by ⁨IndustryStandard@lemmy.world⁩ to ⁨technology@lemmy.world⁩

https://www.engadget.com/llama-31-is-metas-latest-salvo-in-the-battle-for-ai-dominance-150042924.html

Meta on Tuesday announced the release of Llama 3.1, the latest version of its large language model that the company claims now rivals competitors from OpenAI and Anthropic. The new model comes just three months after Meta launched Llama 3 by integrating it into Meta AI, a chatbot that now lives in Facebook, Messenger, Instagram and WhatsApp and also powers the company’s smart glasses. In the interim, OpenAI and Anthropic already released new versions of their own AI models, a sign that Silicon Valley’s AI arms race isn’t slowing down any time soon.

Meta said that the new model, called Llama 3.1 405B, is the first openly available model that can compete against rivals in general knowledge, math skills and translating across multiple languages. The model was trained on more than 16,000 NVIDIA H100 GPUs, currently the fastest available chips that cost roughly $25,000 each, and can beat rivals on over 150 benchmarks, Meta claimed.

source

Comments

Sort:hotnew top

brucethemoose@lemmy.world ⁨3⁩ ⁨months⁩ ago
IMO the more interesting models are 70B and 8B, aka the first models you can run yourself and (for basically the first time) the first open models distilled from such a large “parent” model.

But the release is a total dud among testers because they’re bugged with llama.cpp, lol.

source
- tonyn@lemmy.ml ⁨3⁩ ⁨months⁩ ago
  I’ve got llama 3.1 8b running locally in open webui. What do you mean it’s bugged with llama.cpp?
  
  source
  - brucethemoose@lemmy.world ⁨3⁩ ⁨months⁩ ago
    llama.cpp, the underlying engine, doesn’t support extended RoPE yet. Basically this means long context doesnt work and short context could be messed up too.
    
    I am also hearing rumblings of a messed up chat template?
    
    Basically with any LLM in any UI that uses a GGUF, you have to be very careful of bugs you wouldn’t get in the huggingface-based backends.
    
    source
    -> View More Comments
j4k3@lemmy.world ⁨3⁩ ⁨months⁩ ago
Willing to bet Zuck enjoys Jarvis. Bet there is also a ridiculous back and forth over this with Musk and Altmann.

Any of the 3 could solve American homelessness over night, but build Hawaiian preper bunker islands instead.

At least Zuck is only trying to lead and not monopolize.

source
- IndustryStandard@lemmy.world ⁨3⁩ ⁨months⁩ ago
  I do not understand the goal of Llama. Is facebook trying to make their model so small it will run on a phone?
  
  source
  - brucethemoose@lemmy.world ⁨3⁩ ⁨months⁩ ago
    There are many, but one strategic goal is to “poison the well” for OpenAI.
    
    OpenAI is trying to lobby for regulations that let them monopolize AI, so they are essentially the only ones that can sell it, and instead of playing this game Facebook is seeding public research so they can keep up with closed LLMs and make better cases for themselves. Which benefits them, as then they aren’t a customer of OpenAI.
    
    Another is to attract talent themselves. AI researchers love all this.
    
    Yet another is to set the standard. The llama architecture is THE open LLM architecture because of facebook, and you run into major problems trying to run anything else, fast.
    
    source
    -> View More Comments
  - j4k3@lemmy.world ⁨3⁩ ⁨months⁩ ago
    I’m not sure what entities, motivations, qualifications, connections underpin Lex Fridman with his podcasts/YT channel, but he has interviewed many people in AI including Zuckerberg, Altmann, and Musk. His interviews with Yann LeCunn are quite interesting. Professor LeCunn is the head of Meta AI. His longer interviews are much better in total for showing the lay of the land overview perspective. Some little clip does not do justice to the overall points taken in context, but telling you to go watch an hour long interview to get the answer directly does not work either.
    
    www.youtube.com/watch?v=fshIOoTo40E
    
    This is a 4min clip of LeCunn saying, basically it doesn’t hurt anyone. He’s essentially implying it will hurt OpenAI or any proprietary.
    
    I was trying to find the interview where Lex and Yann talk about the leaked Google memo last year, because that one is really good, but YT seems to be obfuscating that one intentionally in search results.
    
    IIRC, in that one, LeCunn was saying something to the effect of the only way people can really trust AI is with transparency and that requires open source as a foundation. Using something like OpenAI in business is insane. You’re basically selling every aspect of your company to Altmann for peanuts. Likewise with personal use, this is like your life long psychiatrist opening a few side businesses as a political analyst, insurance broker, banker, and healthcare insurance provider, while working nights as a Judge. While you’re asked to sign away any privacy or confidentiality. Models turn human language and culture into a statistical math problem that has far better than 50% probabilities in nearly any aspect of human existence. If you ask a model to give a profile for Name-1, it will tell you all kinds of seemingly unrelated things about the person. The more you interact, the more accurate this profile becomes, even in areas that make no sense, have no logical association, and were never a part of the conversation. It is the key to manipulating people unlike any other tool in history. That is why open source offline AI is the only sensible way to use AI.
    
    source
- RmDebArc_5@sh.itjust.works ⁨3⁩ ⁨months⁩ ago
  
  At least Zuck is only trying to lead and not monopolize.
  
  I think he would, if he thought he could
  
  source
  - mriguy@lemmy.world ⁨3⁩ ⁨months⁩ ago
    If you can’t dominate, the next best thing is to make sure nobody else can.
    
    source
    -> View More Comments
Wooki@lemmy.world ⁨3⁩ ⁨months⁩ ago
What a waste of energy.

Innovation has stopped, not improved. BIIIIIIGA DATA is not innovation.

All for word predicting chat bots. What a waste.

source
- 1rre@discuss.tchncs.de ⁨3⁩ ⁨months⁩ ago
  At least you can (theoretically, if you have your own datacentre or botnet) run, finetune and play with this yourself, so at least it’s somewhat useful, especially if you finetune it for applications where word predicting is actually exactly what you want
  
  source
pyre@lemmy.world ⁨3⁩ ⁨months⁩ ago
I’m glad they named it after an animal known for its spitting. That’s what so-called AI does.

source
homesweethomeMrL@lemmy.world ⁨3⁩ ⁨months⁩ ago
What about the battle for enormous-mound-of-horseshit dominance?

source
- SGforce@lemmy.ca ⁨3⁩ ⁨months⁩ ago
  They haven’t announced any debate schedule yet.
  
  source
- pyre@lemmy.world ⁨3⁩ ⁨months⁩ ago
  they’re all winners on that
  
  source
raldone01@lemmy.world ⁨3⁩ ⁨months⁩ ago
Llama3.1 33b would be so cool. It would be a nice middle ground for my machine.

source