If they do bad things against you, what can you do?
If you don’t accept them what other option do you have?
If you don’t accept them you will be upset, isn’t it? Your mind will be disturbed, and when you are so upset, any decision you take, will you be happy about it? Certainly not!
So for your own sake, accept people and the situation as they are, so that your mind becomes calm. Then you do what you want to do.