That may work, but may cause problems (ruin the amplifiers) if there's any "spikes" as you switch speakers ...
(speakers are inductive)

especially if the volume is loud while you switch them...

Audio (and or video) switchers are designed for only "line level" signals (amplifier inputs)

You'd need a Speaker Selector Switch

Speaker Selector Switch at Radio Shack

Thanks Regus for the explanation and the suggestion. That is exactly what I need. Now, do you have any suggestions on a box to mount it in as I do not want to mount it in the wall? I would like something a little better looking than a light switch box. I need a box that I can sit on top of one of the receivers.

sorry, I don't know ..

you could find any nice wooden box,
then cut the required hole ...

Thanks. That is about the only thing I could thank of. I am sure there are set top boxes with this kind of switch. I will look for them as well.

> I am sure there are set top boxes with this kind of switch. I will look for them as well.

I don't think so,
Audio (and or video) switchers are designed for only "line level" signals (amplifier inputs)

Maybe, if you'd be replacing an audio/video switch in one of those boxes ..

but it may not fit