The cap would be connected as you wrote (like C3 in your circuit schematics, except over the input, not the output). However, as mentioned, this would depend on what kind of output your power supply delivers - if that already has a cap or even a voltage regulator, you wouldn't need it.