its similar to being in a relationship and yearning or not being over a past one - like calling out another persons name when having sex. I know alot of people think that there is a thing called "harmless flirting". yet I have seen relationships and marriages break up after years of being together because of "harmless flirting".
Soon it develops into something stronger, but the worst thing is that the other partner is left always feeling second best - that there is a piece of your heart that he/she can't have. That is the saddest thing of all. When they see and can feel - your not giving 100% into the relationship.
True we all need affection, and there are times that in doing so - we have to admit that a partner (married or otherwise) is 'boring' - sort of like thinking, "ya he's suppose to like me"... but you want more - you want everyone to like you - adore you - worship you. And the feeling of having someone attracted to you - flirting - is tempting for the ego.
The problem is your self worth and lack of communication in your relationship.
Men will understand that love, trust and affection are like oil to a car - you need a certain quantity of it - let it slowly run down to nothing and the engine will burn out. You must continually check your "love stick" and find out where your at - or your going to be tempted with the next cute car that drives by.
If your asking if its right or wrong now - then you already know the answer and are merely seeking confirmation from your friends