if you allow the potatoes to grow like weeds and left unattended for long time, it can be considered a weed, potatoes might not be invasive though. unlike thier poisonous cousins ,black nightshade which is weedy and everywhere.