Comment

Comment on "Did you realize that we live in a reality where SciHub is illegal, and OpenAI is not?"

givesomefucks@lemmy.world ⁨8⁩ ⁨months⁩ ago

You can run your own open source large language models at home about as well as you can run Bethesda’s Starfield on a same spec’d PC

…

Yes, you can download an executable of a chatbot lol.

That’s different than running something remotely like even OpenAI.

The more it has to reference, the more the system scales up. Not just storage, but everything else.

Like, in your example of video games it would be more like stripping down a PS5 game of all the assets, then playing it on a NES at 1 frame per five minutes.

You’re not only wildly overestimating chatbots ability, you’re doing that while drastically underestimating the resources needed.

source

Sort:hotnew top

Auzymundius@lemmy.world ⁨8⁩ ⁨months⁩ ago
I think you’re confusing training it with running it. After it’s trained, you can run it on much weaker hardware.

source
- givesomefucks@lemmy.world ⁨8⁩ ⁨months⁩ ago
  The issue is it reproducing copyrighted works verbatim…
  
  It can’t do that unless it contains the entire text to begin with…
  
  source
webghost0101@sopuli.xyz ⁨8⁩ ⁨months⁩ ago
I am talking about generative AI, be it text or image both have a challenge with copyrighted material.

“executable of a chatbot” lol, aint you cute

“example of video games” It was having a dig at Bethesda… The Vicuna 13b model from huggingface runs mediocre on my 2070 compared to chartgpt 3.5 Starfield also runs mediocore on my 2070 compared to a properly produced video game.

I say its mediocre cause it is, that is far of from overestimating. LLM at home is not a practical for professional use for my standards. Chatgpt 3.5 doesnt hit that level either.

But it is a very interesting, rapidly evolving technology that i hope receives as much future open source support as possible.

“I think you literally don’t know what people are talking about” I hate to break it to you but you’re embarrassing yourself.

I presume you must believe the the following lemmy community and resources to be typed up by a group of children, either that or your just naive.

lemmy.world/c/fosai www.fosai.xyz github.com/huggingface/transformers huggingface.co/spaces/…/open_llm_leaderboard huggingface.co/microsoft/phi-2 & microsoft.com/…/phi-2-the-surprising-power-of-sma…

“Old” article theguardian.com/…/google-engineer-open-source-tec…

source
- givesomefucks@lemmy.world ⁨8⁩ ⁨months⁩ ago
  Or…
  
  I could just block some of the people who are really really into chatbots, but don’t understand it in the slightest.
  
  I think that might be more productive than reading a bunch of stuff from other people who don’t understand it.
  
  source
  - webghost0101@sopuli.xyz ⁨8⁩ ⁨months⁩ ago
    HOT TAKE: Hugging face is run by people who are really into chatbots but dont understand it in the slightest.
    
    I have been patient and friendly so far but your tone has been nothing but dismissive.
    
    you cannot have a nuanced conversation about AI while excluding the entire Open Source field within it. That’s simply unreasonable and i plore you to ask others because i know you wont take my word for it.
    
    Farewell
    
    source