Comment on AI Training Slop

• ricecake@sh.itjust.works ⁨1⁩ ⁨month⁩ ago

  That’s far from saying they’re negligible. What they’re saying is inline with my point. If you find a microwave are you going to research how green it’s manufacturing was so you can ensure you only find good ones for free in the future?

  Irrelevant or moot is different from negligible. One says it’s small enough to not matter, and the other says it doesn’t affect your actions.

  I play with AI models on my own computer. I think the training costs are far from negligible and for the most part shouldn’t have been bothered with. (I’m very tolerant of research models that are then made public. Even though the tech isn’t scalable or as world changing as some think doesn’t mean it isn’t worth understanding or that it won’t lead to something more viable later. Churning it over and over without open results or novelty isn’t worth it though). I also think that the training costs are irrelevant with regards to how I use it at home. They’re spent before I knew it existed, and they never have or will see information or feedback from me.
  My home usage had less impact than using my computer for games has.

  source

  • utopiah@lemmy.world ⁨1⁩ ⁨month⁩ ago

    I’m playing games at home. I’m running models at home (I linked in other similar answers to it) for benchmarking.

    My point is that models are just like anything I bring into my home I try to only buy products that are manufactured properly. Someone else in this thread asked me about child labor for electronics and IMHO that was actually a good analogy. You here mention buying a microwave and that’s another good example.

    Yes, if we do want to establish feedback in the supply chain, we must know how everything we rely on is made. It’s that simple.

    There are already quite a few initiatives for that with e.g. coffee with Fair Trade Certification or ISO 14001, in electronics Fair Materials, etc.

    The point being that there are already mechanisms for feedback in other fields and in ML there are already model cards with a co2_eq_emissions field, so why couldn’t feedback also work in this field?

    source

    • ricecake@sh.itjust.works ⁨1⁩ ⁨month⁩ ago

      I didn’t mention buying a microwave, I mentioned finding one for free. If you buy a microwave you’re a customer and your desire for ethical products can be impactful to some degree.
      If you find a microwave there’s no feedback, and if there were feedback they wouldn’t care because you’re not a customer.

      The way you establish feedback in this field is by making it a viable market, and then giving your money to the most ethical company. I don’t think that any of the companies offer or will offer a product that will be worth the cost or resource investment. Ergo: I don’t give them money or use their products.

      Downloading a model doesn’t change that feedback. It’s digital, so once the resources are spent copies have no additional cost. They don’t get metrics or usage patterns, or even know I have it.

      It’s not quite, but kinda, like saying that you should only shoplift fair trade coffee. This doesn’t signal to anyone that they should invest in making their coffee more equitable.

      source