Both in love, went too quick, he got scared now need space. Lost him??

So I met a guy and it has all gone very quick. We saw each other every single day and I would stay at his house at weekends. We quickly told each other how we had fallen for each other. It gets messy because I have just come out of a abusive marriage and it’s still quite messy. I am in the process of divorce and until then, we wernt able to tell anyone we are together so that it didn’t cause anymore issues for me. He understood but struggled with this (understandably)
We spent all our days texting and calling when we wernt together. He really made effort and it was clear he was into me.
He then gave me a key to his house and the conversation of moving in together took place. He initiated all of this. I said it isn’t the right time however I loved the thought of one day!

He has now said that he is scared, he misses me so much as wishes this was just a few months down the line so that we could be a couple. He said he needs a break. We have both text each other during the break and he came to my house and it was clear he didn’t want to leave.. I am heartbroken and really struggling. It’s taking everything I’ve got not to text him. I’m trying to give him space in the hope he will come
Back to me.. do you think he will come back? I love him!