You may have wired the switch wrong. If you look at the side of the double switch you will see that the two screws on one side are jumpered together, that is the side you hook the power to and the fan and light to the other. If the original switch had 4 wires (2 from fan two from light) then you need to break the jumper between the screws to make two separate switches.