Catholics, or Christians in general, recognise God as the one and only one deity in the world who created the world under the light of the Holy Spirit. Hence, theoretically, all pagan temples are either worshiping false ‘gods’ or Satan veiled behind the statues. In defense of the truth which we understand by our faith, it is justified to destroy pagan temples and their statues.
Yet, the other factor coming into play is the respect for free will. Again, God creates liberty; every human being has his free will to choose whether to accept God and His Gospel. Destruction of pagan temples will be an infringement of others’ religious freedom and thus a disrespect to God’s creation. Moreover, from history we often learn that totalitarian acts spark hatred rather than charity - another contradiction against God.
To resolve the paradox, I think destroying a pagan temple or not is hardly to be categorized as a sinful or sinless behaviour. This dichotomy doesn’t apply in this situation; there is much grey area to be debated.