As a Catholic (which you are by virtue of your baptism) you were and are bound by Church law on marriage as well as divine law. As a Catholic, you were bound to marry in Catholic form or receive a dispensation from form. If you didn’t do so, then the attempt at marriage would not be considered valid.
Since your intended has a prior bond he was not free to marry anyone else and that would need to be reviewed and dealt with. Lastly since he is unbaptized, that also would have and does require a dispensation from disparity of cult from your bishop.
So right now there are three things impeding valid marriage: the form, the disparity of cult, and his prior bond. The first two are easily corrected, but first his prior bond must be dealt with.
Next step is for both of you to sit down with your pastor and get the ball rolling.