What should I do? He is making me feel confused

I’ve been “dating” this guy for a little over a month now. We first met on happn. We live only a 5 minute walk from each other, so meeting up is very convenient I guess. We usually don’t make plans to see each other, it’s usually a last minute thing. The times that we have made plans to see each other however, I’ve been the one to initiate.
I asked him out on a date a few weeks ago. His first response was “That sounds nice. But why do you want to go out and have a drink by the way? We can just hang out.” I told him (kinda annoyed at that point) that it would be nice to do something else together, to get to know each other better. And that in fact I wanted to go on a real date with him. He apologized, told me he had a lot on his mind, and that he really wanted to go on a date. Then comes the day of the date. I send him a message asking him if he’s ready to go. He replies 30 minutes after we were supposed to meet up saying he doesn’t feel good, that he’d rather stay home and relax. I got mad, and replied telling him I didn’t think it was ok to cancel the date after we were supposed to meet. He apolgized and said he realy wanted to see me, but that he just wasn’t able to see me that day. We managed to plan a new date, and he then told me that he was struggling with anxiety, and that he had anxiety the day he cancelled on me.
He said that there are very few people in his life that know about the anxiety, and that he trusted me enough to tell me this. But then he continued saying that the day before the date he was hanging out with a friend of his (a girl btw), and they had stayed up very late watching tv shows or whatever, and she stayed the nigth. And the day he was supposed to meet me, he hung out with her instead… It seemed like she was helping him with the anxiety, but I can’t help to think that this is just kinda fucked up.
Last time I saw him was two days ago. I had bought a lot of beer and food, and made him some delicious pasta. I also put on a really nice top, made myself look awesome (I really thought I looked pretty hot that day). And I guess I was hoping for him to compliment me for the food, the beer, the way I looked. But he didn’t. He also didn’t kiss me, which is something he rarely does, and it’s really confusing to me. I kinda feel like he treats me like a friend, and nothing else.
I know this story was kinda messy, but the point I’m trying to make is that I’m very confused about what this guy really wants. He never plans to see me, but we still see each other usually twice a week. He doesn’t kiss me, only when we say good bye he gives me a slight peck on the lips. He likes to cuddle though, so cuddle a lot. We have had sex, but we don’t do it very often, and he rarely initiates that. We only communicate via snapchat, I don’t have his phone number or facebook. He doesn’t snap or chat with me every day. I used to initiate the conversation every day, but now I wait for him to do it, and it sometimes takes two days for him to reach out.
So what do you think? What should I do? I am considering just ending it, because it’s messing with my head. But I really like him.