what do you fill them in with? Thinset?
I've used leftover grout to fill mine. I keep the thumb hole open so I can stick it on a metal pipe pounded in to the ground to display it.
I use wood putty. Works well, but I do fill the holes in partially with aluminum foil and then apply the wood putty.
I've used tin foil and thinset