Do you have visible mold?

If your walls have visible mold then they are holding moisture within. This breeds mold spores in which you are breathing in your living space.