I have found a real solution. Spray WD-40 into the hole. Yo need to use the one with the stick on the nozzle. Put the stick into the hole and spray a good amount. The bees will come out and fall to the ground dead. It also kills the larvae they lay in the holes. That is why they are boring in the first place.
If you spray the WD-40 on the bare wood, they will not go around it. I sprayed it all under my deck and they have not come back. Try it! A family member from up north told me to do this and it has worked great for me!