If I agree with the moral logic behind it, then yes - it’ll upset me even if I’m not personally affected. If I hear someone shouting slurs at a black person, I’ll obviously take issue with it, despite not being black myself.
On the other hand, if I hear someone say, for example, “this thing is retarded,” then even if society broadly considers that offensive, I still wouldn’t personally have a problem with it - because I don’t agree with the reasoning behind that judgment.
It's not that the output of an ASI would be incomprehensible but that as humans we're simply incapable of predicting what it would do/say because we're not it. We're incapable of even imagining how convincing of an argument a system like this could make.