I think it depends how you want to personally define “using you for sex”. If you define it as having sex with you without having any feelings for you, then no, he’s not using you for sex because he does appear to have feelings for you, he just doesn’t want any kind of further relationship with you. If you define it as having sex with you without any desire for a further relationship, then he’s definitely using you for sex.
Either way, whatever you want to define it as isn’t really the important thing. You’re looking for a relationship, and he’s not, which means you two aren’t compatible as far as a relationship goes.
