The word “go” has lots of meanings besides physically moving to a place. It also means to change state (“the milk went bad”, “he’ll go crazy when he finds out”) and to indicate immediate future tense (“I’m going to read this book now”). Not to mention some other less relevant uses.