Real Catholics know that among the Apostles, only Saint Peter is known to have been married because his mother-in-law is mentioned in the Gospels, but no mention is made of his wife or children. Tradition tells us that he was a widower who was caring for his wife's aged mother. Some of the others might have been married, but there is no indication of this and it is a clear that they left everything, including their families, to follow Christ.
From the beginning, continence was required for priest and bishop -- priestly celibacy is an Apostolic norm, for from the beginning, continence was required for priest and bishop – for Early Church Tradition the most important studies are: Apostolic Origins of Priestly Celibacy, by Fr. Christian Cochini, S.J.(Ignatius, San Francisco, 1990); The Case for Clerical Celibacy, by Alfons Maria Cardinal Stickler (Ignatius, San Francisco, 1995); Celibacy in the Early Church, by Fr. Stefan Heid, (Ignatius, San Francisco, 2000).
There is no question that Priestly continence was the norm from the beginning and there were no legitimate exceptions.
Here is more testimony to the truth:
Fr. George William Rutler, in an article entitled A Consistent theology of clerical celibacy *(*Homiletic & Pastoral Review, Feb. 1989), notes that "Virginity and celibacy were not synonymous in the original ecclesiastical institution of celibacy. Those clerics whose marriages were recognized by the Church, and they were many, were expected to abstain from conjugal union after ordination. The new archaeology shows that this was the case for all the Eastern Churches in the earliest centuries, and in a mitigated form later. In the Latin Church this was the clear rule throughout the first millennium, culminating in the laws of the Gregorian reform, especially as found in the First Lateran Council of 1123, and the Second Lateran Council of 1139...The discipline of the Second Lateran Council explicitly forbidding marriage after ordination was not an innovation in the observance of continence. Its prohibition of clerical marriage was only a regulation ensuring that the apostolic norm of abstinence would be better observed."
Priestly Celibacy and Its Roots in Christ … Interview with Fr McGovern
National Catholic REGISTER, May 19-25, 2002
“Recent scholarship on the history of celibacy in both the Easter and Western Church has shown that there is a considerable body of evidence in favour of the argument that priestly celibacy is of apostolic origin, based on Christ’s invitation to the Twelve to leave all things and follow him (cf. Mt 19:29).  Indeed, Saint John Paul II points out in his 1979 Holy Thursday Letter to Priests that celibacy is so closely linked to the language of the Gospel that it refers back to the teaching of Christ and to apostolic tradition.”