Did I cut him off too early?

I met this guy at work randomly and he caught my attention after breaking up a long term relationship. He was on the same situation . We exchanged numbers and started texting like a day after nonstop and ft as well. Everything felt genuine, we went on a date and I slept over it was a great time as well. After we continued speaking through the phone almost everyday(mind you we live 40 mins away from each other) he would say he wanted to see me again and me as well but we both didn’t want to drive. However I didn’t pay much attention because at least he was still texting and ft me. Days passed and he will hang out with his friends& go to parties but he will always call me right he was back home or text me sometimes when he was drinking. I started feeling like he was using me just to have somebody to talk to since he wouldnt come see me so I started distancing myself and not textt him fast or answer dry asl, so we kind of stopped talking for almost 3 days and then he would text me again. at the time I wasn’t speaking to him I noticed he commented on a girls pic and he kept on following girls and unfollowing them so I thought he’s craving attention ig but we were not dating so he texted me again and asked me if I wanted to stop talking to him and I wasn’t brave anough to say yes, but I did tell him that he just wanted to meet more people and party and I wasn’t in that position, he legit said he didn’t want a relationship and didn’t expect anything from me. So he kept on texting me and I was super dry and answered even more later. We had stop chatting for 5 days last week until I posted something and he texted me asking me how come I haven’t hit him up. I told him I did t want to waste my time. He said “I’m sorry to be bothering you” and I said “you’re good” 3 hours later he unfollowed. Soo did I do wrong by cutting him off early? I really liked him I just didn’t want to end in that “let’s see where it goes situation” and then get attached without having something serious . Should I have kept it cool and just see where it went?