If it's to his ex girlfriend, then there is nothing to worry about. If it's for curiosity, then talk to him and ask him to cherish what he has now.

If it's something else and you guys live together, then think about what you did wrong make him do things like these. Are you too dominant? Do you care about his feeling enough? ... If he feels happy and perfect with you, I believe he would never do that.