I can't say that there isn't such a device, only that I don't know of it.
I can think of a way, with a toggle switch, which MAY work OK but would present a lower impedance to the circuits driving the potentiometer. Obviously I have no knowledge of those circuits.
If you want to try it get a switch like this example:-
https://cpc.farnell.com/multicomp/1md3t6b11m1qe/switch-dpdt/dp/SW02869?st=toggle switch# You only need to wire one side of it.
Get two resistors half the value of the potentiometer and wire these between the central terminal and each outer terminal of the switch.
Transfer the wires from the potentiometer, centre to centre, outer to outer.
This arrangement will appear (electrically) to the amplifier it's feeding exactly like the potentiometer, BUT will present a reduced resistance to the circuit which is driving the potentiometer.
An alternative compromise with this arrangement is to use resistors the same value as the potentiometer..
Given that resistors are a few pence each you could try both and see which works best. You are unlikely to do any harm; it just may not separate or mix the signals as well as at present.
No promises! This is guesswork!