Do not look in the eyes, look att people's mouth instead. All men look at sexily dressed women, that is why women use sexually attractive clothes. Do not stare. Try to be discreet so the women do not notice it. A girlfriend would perhaps help you to be less interested in other women.
Your reactions sound like a so-called conditioned reflex. Search with Google with the question "unlearn conditioned reflex". I did this, and found the following article, which might be helpful to you.
You could also try to develop a suitable conditioned reflex. Every time this happens, immediately look at her mouth. After doing this a number of times, you will have developed a conditioned reflex, so that every time you see an attractive woman, you look at her mouth instead.
