You don't want the cat box to vent back into the bathroom when the cat box fan is running but the bath fan is not. I'd go ahead and give it an exhaust of its own.

With 5-15 foster cats in our cat rooms I need to keep the vents running full time. For one cat the motion sensor idea might work, but the litter doesn't stop being aromatic after the cat has left.