No way would I have folded that from the small blind in an unraised pot--as rondavu says, there's a good chance you're holding the best hand at this point.

I would have struggled to get away from this hand as well--the guy was just calling, and I probably would have put him on a bare Ace without good data (e.g. showdown seen % < 10).

Only possibility of saving a bit of dosh here that I can see--how about check-raising the turn here. From the position you were in it seems quite an obvious move (I'm no pro, mind). You check, he probably bets, you raise. If he re-raises you've got to start to smell a rat.