Coworker ghosting

So I’ve met this guy around 6 weeks ago at work, we are both new to the city. Everything was great, we went out with his friends and kissed at night and he drove me back to my place and left. He is such a gentleman, we’ve been hanging out a lot since then. He comes to my place and we flirt alot but we didn’t have sex yet (i told him i wasn’t ready) so he just spends the night. We talk alot, he always asks what i am doing etc.. We haven’t discussed us yet, he is not very communicative and he knows it. I’ve always seen girls name s on his phone but never questioned it since it’s too soon and since he spends most of his time with me so I kind of trust him. I recently went off home for the weekend and I feel that everything has changed. Although he shared what he did for the weekend, I just feel that something is not right. He texts less now, and he has his ‘friend’ coming from france (his hometown) this weekend so he is very excited to see her and hasn’t made any plans with me yet. I see him at work he is completely normal, even texts me at night but way way less and we didn’t go out since I came back from home (4 days ago) and I’m not sure why I feel this insecure. I’m not sure what to do, should I confront him, should I leave it and stop thinking about it, should I be worried about his weekend with his friend… I’m not sure what to do but my anxiety is killing me, I don’t understand what’s on his mind.