I suppose it depends on what community you’re in. Interpersonally, even in very liberal communities, white people have complained to me about this when no one else was around. There is currently a movement that is gaining strength under Trump to undo affirmative action, and memes like this are going around:

Maybe it’s not “most people” (though, maybe it’s more than you think; Seth Stephens‑Davidowitz analyzed a bunch of Google results and found people in private are a lot more overtly racist than they admit in public) but I think it’s enough people to create some problems.