Lama Ole’s answer:
That depends on your view. Annoyance can also arise from idealism—for example, if you think, “They are so wonderful and now they’re doing something so stupid again!” This type of annoyance, where there is no intent to harm beings, is actually a kind of disappointment.
If you see people on a high level, if you are sometimes disappointed by them but don’t give up your high view, if you still expect exciting things from them, then it is something good. But if you think they are impossible, then it really is anger and something negative. It can be good to sometimes shake people up if you like them. But if you want to harm them, then it’s not good.