Many men of his age do not have much of a sex drive left. And women over 40 are often more interested in sex than ever before. You cannot change him and it is not your fault. You have to accept him the way he is. If you want a lover, you should try to find someone younger.