I think you have your answer. This is not going to work out. If he has small children, he will be unable to fully commit to you. Even if he wants to totally commit to you, he will always be charged by the court to take care of these children. You should move on unless he is a fantastic person with financial resources that are unaffected by the $400/week. He will have no choice with the kids, talking to the ex-wife is totally unacceptable. He should only speak to her as a way to arrange time with the children. Also, I think that all weekend is ridiculous with the kids. How about a day or less.