I've tried it with a 9v DC 500ma transformer, a 9v AC 200ma transformer I ran thru a bridge, a 12v computer power supply, a 12v car battery charger, and a self built 12v DC transformer, many 9V batteries, and 3xCR123's.
All eventually drop off. I have also rebuilt the circuit. Much neater...