Sterling didn't want is mistress dating black folks. (never mind the lack of morals on the whole fidelity issue) This isn't the same as being unwilling to associate with blacks.
That is not accurate. He did not want her to
be seen associating with them, particularly at Clippers games. He said he didn't care if she had sex with them.
So his specific issue
was with public association with blacks; both with how it would affect public perception of her, and how that would affect public perception of him.