The people whose compensation depends on your opinion have ample time to remember and analyze your past words and decisions – more time than you, in fact, and a stronger incentive. And so their mental model of you is often much better than your own.
Your mental model of yourself is based on your internal thoughts.
Everyone else’s model of you is based on your words and actions. So it’s arguably more “correct.”