Certainly we should do something.
Matthew 18:15 gives clear biblical evidence that we aren’t just supposed to pray about a problem but approach the sinner directly and if they don’t listen, you keep going until the whole church knows.
So, we should listen to our brothers and sisters in the church when they are aware of some wrongdoing.
Specifically, I know that an Archbishop who was a priest in my Diocese was recently convicted in court of withholding evidence against a priest and he wanted to retain his position until he could appeal the judgement. There was an outcry among the Catholic community and society in general and he was pressured to resign. He has been sentenced to home detention for less than a year at his sister’s house. What a punishment!
So yes, we definitely have to give people a hearing and let the truth come to light. Be a bastion for the truth!