yeah that's a good point mike! you will get losses somewhere in the circuit because everything isn't 100% efficient, even the capacitor can lose a couple of millivolts for you! the pot might loose abit of power, and the LM317 uses the power to regulate. so you have to take that into account as mike said.
good luck guys!