I love myself more, but I want a safe and calm outing

I am trying to leave this DV relationship, but it's complicated. He lives with me; he uses my phone and car because he doesn't have neither. I don't want to get the police involved nor do I want to kick him out, 1. he will just be outside my apartment unit and 2. defamation of my character - for some reason everyone believes him and don't see any wrong by him but he sure can make someone look terrible. He is leeching on me. I feel like I'm being suffocated by a hurt boy who have been wounded and traumatized all his life and he is using me as an energy bank to cure his wounds and to cater to his needs. I currently have a cold and he hasn't taken care of me or even asked how I am doing. From the many times I haven't felt well, he would argue with me. I feel so alone and feel like I can't make any plans until he can get a phone and car. Friends say call the police, but I really don't want to, I don't want him to destroy my reputation. My therapist said that if my reputation is the only reason I am putting up with him then I shouldn't worry about my reputation. I understand where my friends and therapist are coming from, but I really don't want that to happen to me, I have seen what he did to his baby mother and it just been a shit show. Am I wrong to want a calm and safest way out?