Yes, it means that their basic architecture must be heavily refactored.

Does it though? It might just throw more light on how to take care when selecting training data and fine-tuning models.