I feel that, when in public, and not engaged in civil work nor physical toil, it’s appropriate for them to dress in clerical garb. Either clerical collar shirt, or cassock.
When holding a civil job, no. Some other form of christian witness is, however appropriate.
When performing physical toil: no. whether that be mucking stalls, raking the rectory lawn, or hammering away, that’s better served by more suitable garments.
When engaged in sport: proper attire, but specifying Rev. Fr. ___ in the name area…
When around the rectory for normal daily life, not by need. But they should have a cassock ready to go, just in case!