I mean that’s a pretty massive undertaking.

If that’s your goal, don’t bother with pytorch at all.

Start by implementing the individual algorithms required to do a simple machine learning algorithm from scratch (only numpy).

You need to learn and be able to encode back propagation, Adam, sigmoid, etc… I can’t remember them all off hand but it’s like maybe 4 or 5 different functions in total.

There are many tutorials for this. If you need me to, I can link you to some.

This is a great way to get the basics down, however, beware that things like pytorch are ultimately collaborative projects involving thousands of team members incorporating advancements and research from all kinds of sources.