The person doesn’t have to have a weapon to be a threat to your lif. Based on your logic someone could say I’m going to beat you to death and go about doing it and 10 minutes later with 17 broken bones you’d have no case for self defense that doesn’t track at all.
I think you misunderstand