If you want to hang out with elderly people, just go to a Catholic daily Mass or to any sort of parish function after the Mass like coffee and donuts. They’re all there. Sometimes I chat with them there. I’m sort of practicing for becoming old myself. Also, I tend to like elderly people more than I like hanging out with young people/ kids.
My hometown also had a senior center with lunch and activities, where I used to volunteer and where my parents spent some time when they became elderly. That was another place to connect with older people.
I haven’t tended to see a lot of “warehousing” of elderly people or them being particularly isolated from society. They have social and family lives for the most part, even if their social life just consists of seeing their friends at church or McDonalds or saying hello to the yard man or the grocery clerks. I’m sure there are some who are more isolated but overall the families I know aren’t anxious to reject Grandpa just because he’s old. The ones in care homes are generally there because they need medical care beyond what a family member can provide.