You absolutely have a right to be concerned since your husband left you for this ex-girlfriend for six weeks fifteen years ago. He shouldn’t have made dinner plans to have drinks with her without including you, and the fact that they segued a drinks date into dinner, and then went back to her house sounds mighty suspicious.
It sounds like he’s not done with her and he’s not as committed to his marriage with you as you would like. 🙁