I'm Kenyan. I Don't Write Like ChatGPT. ChatGPT Writes Like Me. via Marcus Olang'

This is a great example of preference tuning away from an accurate world model (in this case, tuning by the Kenyan reinforcement trainers on LLMs to their idea of perfect written English).