At 12V a 1K resistance (the pot turned all the way down) will only let 12mA through, that is 0.012 amps. 12mA @ 12V = 144mW. Your DC fan would need more than 10X the current the pots will let through to spin at full speed, I'm surprised they worked at all. How did you have your circuits set up? What is the wattage of the Pot you are using? I would guess your pots are really 1MOhm pots which have a resistance of ~0ohms when turned down fully. At this resistance, your fan will be supplied the full 160mA which at 12V is well more than the pot can handle runing through it's contacts. At 12volts a 160mA (0.16 A) current results in 1.92W (watts). Most pots I see are 1/4watt (250mW), the higher wattage ones are typically more expensive and aren't often found easily.
For full speed you would need a resistance of 75 Ohms, so use a 100 or 500 Ohm pot in series with a 68ohm resistor and a 10ohm resistor. Make sure the wattage ratings on all the components are as high as you can get if you can't get them around 2W.