This is problem situation for me too. However, I think you should even call all in with set on a suited flop because you still have outs to win and you are never absolutely sure he has flush. He might have a flush draw and got extremely aggressive with it. Post details.