I think the difference is how influential they are on your community. Keeping an immature mod for whatever reason sounds unreasonable to me. Some do that to keep the forum going, as mentioned above, and some do it because drama is a good discussion booster. By the time they realise the mistake, it will be too late.