I think you need to replace the exhaust fan or maybe the insulation in the attic.