doesn't text but happy to meet

Hi, So I had 4 dates with this guy, who rarely texts between the dates. we live in the same city and we had 4 dates in 2 weeks, which to be honest is a lot now that I think about it. We had a lot of free time, because where we live everything was closed , now things are re-opening we can see each other maybe once a week if that.
He said we can meet on Sunday but he will confirm tomorrow as Sunday is his only day off so I understand he might want to see his friends or just chill on his own.
But what bothers me is the fact that he keeps saying let me know when you’re free and then I have to reach out to him to sort of arrange a date, it only happened once so far but still to me it seems like low interest. He doesn’t keep the communication going between dates, I know he has a busy life and can’t really text at work so he only replies when he is home.
He also said that in the past women were all over him, when he broke up with them they couldn’t let go, too confident maybe but maybe he is used to women chasing him?