Loving a friend who is using me?

I knew him since 6 yrs ago and he is one of the friend in the group which i hang out frequently. I believe we have attraction towards each other. We used to be sexual partner (he's not my bf but we had sex many times)5 yrs back. Sometimes it happens when he or me is drunk, sometimes we are sober. I quit doing that when i had a boy friend. But then when i'm single again, it kept on happened between us. Until now, I'm really confused how he feels for me. Sometimes I can feel that he likes me, but sometimes I feel that he's only treat me as a friend. He is a kind person. I dont want to believe that he is using me all this while. If he has no intention to go any further than just sex, I dont want to believe that this is it. Recently, after 6 months we quit having sex, it happened again last week. I tried to stop and rejected him a few times, but many times I cant resist because I fell in love with him. I am feeling bad and nervous now because I dont know what else I can do. I know nobody can give me an answer to my complicated situation but at least please advise. Thanks.

You are hoping for something else than just sex. Be honest with him and ask him if you have a chance to be his girlfriend.