It's easier said than done, but if you've decided that it's not going to be a lasting thing, make sure you don't get attached.
To avoid falling in love with your, em...lover, don't get to know him too well and avoid going out for meals, to the cinema, for weekends away, or general things couples do together. Your passionate encounters are enough - you can't have your cake and eat it.