I’m a bit surprised you ran into Catholic-bashing at the Presbyterian church. My in-laws and husband are Presbyterian and my mother also had a good friend for a while who was a Presbyterian minister. They seemed to have much less animosity towards Catholics than several other Protestant churches I could name. This was in the United States however, maybe things are different where you are.
I think a few times a year should not be a problem. As your kids get older, you might have to explain any “Catholic bashing” statements they hear to them, but better they get an explanation from you than encounter it out in the world and be unprepared for it.
Edited to add, I will have to be honest - I personally probably would not have gone to a Presby service - but we did not have children for the grands to “show off” and also, my husband and mother-in-law were very irregular churchgoers. It was only my father-in-law who really bothered to attend his church and even then, not every Sunday. When we visited them, my husband would take me over to the Catholic church, drop me off, and pick me up after the Mass and everybody was fine with that.