The ability to generate plausible language was a lack of compute power. The actual programs running the LLM is not complicate.

The model that is produced is complex.

Its training required compute power that was not previously available but the math/code behind these systems is not complex. They are resource intensive. There is a difference that a layperson often cannot comprehend.