Having spend some small time in the information theory and signal processing world, it infuriates me how often people champion LLMs for writing things like data dictionaries and documentation.

Information is measured in information theory as “the difference between what you expected and what you got”, ergo, any documentation generated automatically by an LLM is by definition free of Information.