Comment

I haven’t really done Neural Networks in 2 decades, and was under the impression that NNs pretty much dominate Machine Learning nowadays, whilst stuff like Genetic Algorithms were way less popular or not at all used anymore.

Is that the case?

source

Sort:hotnew top

howrar@lemmy.ca ⁨1⁩ ⁨day⁩ ago
Neural networks are a class of models. Genetic algorithms are a class of learning algorithms. You use learning algorithms to train models. Genetic algorithms are a valid way of training neural networks, but this is not currently in vogue. They’re typically trained via gradient descent.

source
Nikls94@lemmy.world ⁨1⁩ ⁨day⁩ ago
I don’t know if it is the case for the world today, but all those Models behave like genetic algorithms and IF-functions with a little RNG sprinkled on top of them.

source
- Aceticon@lemmy.dbzer0.com ⁨1⁩ ⁨day⁩ ago
  You mean that they’re actually competing multiple variants of a model against each other to see which ones get closer to generating the expected results, and picking the best ones to create the next generation?
  
  Because that’s how Genetic Algorithms work and get trained, which is completelly different from how Neural Networks work and get trained.
  
  Also the links in Neural Networks don’t at all use IF-functions: the output of a neuron is just a mathematical operation on the values of all it’s inputs (basically a sum of the results of a function applied to the input numbers, though nowadays there are also cyclic elements).
  
  source