I’d say dont drive if you arent comfortable, but not driving can be a huuuge impediment to your work and personal life, depending on your lifestyle. This also might be a good way to build your confidence overall, as it’s pretty obvious youre more anxious in general than most.