I pulled this from an op-ed by Arthur C. Brooks in the New York Times this weekend:

The Princeton psychologist Daniel Kahneman and his colleagues measured the “negative affect” (bad moods) that ordinary daily activities and interactions kick up. They found that the No. 1 unhappiness-provoking event in a typical day is spending time with one’s boss (which, as a boss, made me unhappy to learn).

This is simply the nature of the relationship. As a manager, this is the ground on which your relationship starts, and it’s up to you to build something better.

Related: Your Boss’s Work-Life Balance Matters as Much as Your Own