Can affection be earned?

Hi, I haven’t posted in a longtime so please be gentle :)

I am needing advice. I met a guy at work and I knew he was interested fairly early. I liked his personality and work ethic but did not feel it right to have any personal relations or interaction at work. He became like a socialite always organizing pub nights and outings and I went with other coworkers. I had fun. I never was physically attracted to him. I just liked his spirit and openness. Our work changes locations, and somehow we were still always in the same group for months. And now, I am not working and he is. He helped me move on his days off and nights, gave me so much attention and support about my problems. He even did a renovation for me because I was stressed to find a contractor. I was very closed about letting anyone into my life.

I know a few weeks ago, he tried to hold my hand, and I told him we could just be friends.
He said why do I say that, we hang out all the time. We really do hang like every other day. I told him the work problem and he said he would quit our company which is ridiculous.. But, it blew me away that he would even say that.. In the past couple of days, I see him different visually. I am attracted but it’s different than I have experienced. It’s dependance and stability that I know he is not fooling around. I feel safe.
Is this affection?