Why large language models are bad at imitating people

Large language models like ChatGPT and Copilot are useful for many things. However, they are not yet good enough to imitate the way people speak.