First off, if we take this person’s position to its logical conclusion, then no Christian would ever have to go to jail, pay a fine, return stolen goods, or suffer any other temporal penalty for their misdeeds.
Anyway, here is a good passage that shows God still punishes His children for their sins, but it is purifying and leads to justice.
Hebrews 12:5 And you have forgotten the consolation, which speaketh to you, as unto children, saying: My son, neglect not the discipline of the Lord; neither be thou wearied whilst thou art rebuked by him. 6 For whom the Lord loveth, he chastiseth; and he scourgeth every son whom he receiveth. 7 Persevere under discipline. God dealeth with you as with his sons; for what son is there, whom the father doth not correct? 8 But if you be without chastisement, whereof all are made partakers, then are you bastards, and not sons. 9 Moreover we have had fathers of our flesh, for instructors, and we reverenced them: shall we not much more obey the Father of spirits, and live? 10 And they indeed for a few days, according to their own pleasure, instructed us: but he, for our profit, that we might receive his sanctification. 11 Now all chastisement for the present indeed seemeth not to bring with it joy, but sorrow: but afterwards it will yield, to them that are exercised by it, the most peaceable fruit of justice.