Provided the bounds are kept, it’s possible. It may be a problem because it can give scandal.
Keep in mind that consecrated religious in certain communities have segregated quarters but common everything else.
Having spent a lot of time around a Dominican run parish, the Dominican friars live in community, a community of mutual support, companionship, and filial love; the community I spent time around (and working for) had half a dozen brothers and two sisters… 4 of the brothers were priests… And it’s a good model. The sisters had their quarters in a separate building (“The Little House”) just outside the rectory; the brothers lived upstairs in the rectory, and all had their offices on ground floor, ate in community, prayed in community, and still have common recreation as a community.
The Dominicans provide an ideal model for such a life: separate quarters, but shared lifestyle. Adjacent apartments. Or a cabin and a house on one lot.
Traditional Eastern monastics often have dual monasteries as well - sisters on one side, brothers on the other, chapel, refectory, study, and workrooms central.