It sounds like you need some help with boundaries. 😉 If you want to break up with him, then you should sit down with him and do so, calmly and peacefully. I think you’re upset about a lot of things that happened in the two year relationship and you’re disappointed at the way things have turned out. I’m very sorry for all of that. But…. the best way to break up with him is firmly and kindly. Don’t get angry, just be sad that it didn’t work out and try to work out an exit plan. The best way to do so is to either ask him to leave, or you leave. Kicking him out should be a last resort.
The logistics on who lives where should probably be determined by your lease. If you’re both on the lease, then you both have a financial obligation. If just one of you is on it, then just one of you has the obligation. If you’re the lease holder then the housing obligation is your responsibility. Read the agreement that you signed with your landlord and you should be able to figure out your options that way. 🙂