This is called the Madonna-whore complex. If you are not satisfied with this solution, you need to find another man who loves you and wants to make love to you.

Wikipedia describes the Madonna-whore complex in this way:

The term Madonna-whore complex refers to a psychological complex in Freudian psychoanalysis that develops in the human male. The term is also used popularly, often with subtly different meanings.

According to Freudian psychology, this complex often develops when the sufferer is raised by a cold and distant mother. Such a man will often court women with qualities of his mother, hoping to fulfill a need for intimacy unmet in childhood. Often, the wife begins to be seen as mother to the husband — a Madonna figure — and thus not a possible object of sexual attraction. For this reason, in the mind of the sufferer love and sex cannot be mixed, and the man is reluctant to have sexual relations with his wife, for that, he thinks unconsciously, would be as incest. He will reserve sexuality for "bad" or "dirty" women, and will not develop normal feelings of love in these sexual relationships.

Popularly, the term is used to describe an unsatisfiable desire by a man to have his wife or other female partner exhibit both of these mutually exclusive traits. This introduces a dilemma where men may feel unable to love any women that can satisfy them sexually and are unable to be sexually satisfied by any women that they can love. Alternatively, the term is to describe or attempt to justify the behavior of men who pursue multiple women as a way of fulfilling each of these needs.

Psychotherapy can often help people like your husband.