I've just completed my first pedal, very basic, completely passive. My effects chain is split into two signals, I wanted something that could blend the two signals back together for a mono input into my amp. I had been using a Boss RC-20 loop station as it has 2 inputs with individual volume controls but it's a pain to carry around if I'm not using the loop function, and, well, I wanted to have something I made myself.

The footswitch is a little closer to the lower volume control than I'd like, but my tools and resources are limited so I had to go with a Radio Shack project box, which has all sorts of inconvenient inner structures that make it hard to place components where I'd like...
So far so simple, 2 inputs, 2 500k volume pots, a switch to kill one input signal and leave the other active, one output. Does more or less what I need it to. However, the two volume controls affect each other in the same way the volumes controls of, say, a Les Paul do when the pickup switch is in the middle position. It's a lot more noticeable than that though, as there are two very tonally distinct signals so the volume controls only have a very narrow range (between, I would say, the 8 and 9 positions of a knob numbered up to 10) where they are effective; otherwise one signal is totally dominant and the other inaudible.
Is there a quick fix for this? I feel like there should be a pretty simple component that I can put between each volume pot and the output that will just shunt the signal in one direction and stop it feeding back into opposing volume controls, but I don't know exactly what component that would be (my high school electronics theory thinks maybe a diode?) or what specific value of said component I would need to use.
Any suggestions/advice?

