It would bother me some, but to be honest, probably not much.
When my parents baptized my older siblings, they chose Godparents the way most people do, and those people never had a "godparent" relationship with my siblings. My parents were disappointed. So when I was baptized, they decided that "everyone at the baptism" would be my Godparents (I was baptized in their living room, and no you're not actually allowed to choose "everyone present" as Godparents, but that's a whole 'nother issue), and as you might guess, I've never had a Godparent-like contact with one of them. Ever. And my parents chose close friends who were strong in their faith for all of three of their kids' baptisms.
My situation may not be typical, but I think it IS typical for Godparents not to have a godparent-like relationship with their Godchildren. Even when it's family, even if they acknowledge the special relationship, they rarely actually encourage the children in their faith, or help the parents do the job of teaching the faith. And it's also common to choose friends as Godparents, and then to move or drift away so that you don't have contact with them when the child is old enough to have a relationship.
These things aren't good, or how they should should be. But it is reality for many Catholics. Perhaps that can be a consolation to you, that aside from how they were chosen, the rest of it isn't really all that unusual.
Dh and I have tried to do better as Godparents to our Godchildren, and we chose our kids' Godparents with the hope that they would do better as well. So far, they are. But you know what? If they weren't, our children's faith instruction wouldn't be any different, and while having a "special relationship" is nice, it really isn't the goal of a Godparent. The more the parents teach the faith to their children, the less the Godparents are needed.
Actually, the most useful thing we do for our Godchildren is pray for them regularly. We didn't used to do it, but the people who are our kids' Godparents kept telling my kids that they pray for them every day, that it finally stuck in my own head, and now, when our family says night prayers, we always include a prayer for our Godchildren.
It's possible that this couple DOES pray for their Godchildren (and it's possible they have others like yours, to whom they were assigned by the Pastor). But since you don't know, you CAN pray for THEM. You could even let them know - ie. send them a Christmas Card each year, saying that you pray for them, the Godparents of your child, every night, kind of as a hint. Or have your child do it when (s)he is old enough.
Or just let it be, knowing that your situation isn't all that unusual after all, and just be that parent that teaches the faith really well anyway. And then work on getting to know some Catholics as friends, so that Godparents or not, they can encourage you and your family in your faith in general.