How do I moisturize the air without a humidifier?

I live where it gets very cold and dry.My little ones and I are affected badly by the dry air. We can’t use our tap water in a humidifier because of the chemicals. We don’t have the space or money for jugs of water. I’d like to know if there is another way to moisturize the air in our home.
The chemicals in the tap water make the water coming out of the humidifier smell horrible (best way to describe it is like urine) and leaves a white film all over everything. it also does that when we boil it. About the distilled water, like I said we don’t have the money or space for the gallon jugs.