I'm sure there is a lot of information on the internet about controlling them. We used to plug up their deck holes with cigarette filters, just the right size. I happen to like carpenter bees and do stare-downs, weaving and bobbing. But...we also have an infestation; they live in neighbor's roof. It's only in spring and hot days that they are a real problem. They don't land on you, fortunately.
If possible, put up swallow (a bird) housing, because these insects are treats for hawks and swallows, I'd imagine. I've seen hawks swoop down on my carpenter bees and scoop up two at a time. They are pollinators, so don't use pesticides, unless as a last resort, because will also kill honeybees.