Dating depressed bipolar man. Bad idea?

Hi all. Need some advice. I’m 32 and have been dating a 31 year old for a few weeks. At the beginning of our relationship he told me of some odd behavior and revealed he had bipolar disorder. I had reservations but he is medicated and in therapy and I like him so I continued it. It started off very nice and he was attentive and passionate. We saw eac other a few times a week and then he cancelled on me because he got sick with the flu. I told him if this is moving too fast we can slow it down and he went into a weird tangent about me scaring him by being needy and insecure. He told me he listed in his head reasons not to like me. I was angry and hurt by his extreme reaction. The next day he apologized profusely and asked for another chance. Idk why but I gave him one. We hung out on Friday and we were intimate. He told me he was staying overnight but then he told me he didn’t bring his overnight bag and left at 3am. Things were normal until I asked him to hang out on Sunday. He said yes then suddenly his cat got sick on Sunday morning. He didn’t officially cancel but he left me hanging all day while he was “with his dad.” And blew off our plans. He didn’t reply for several hours and i got angry with him and asked him why he did it and he said because he was a “selfish piece of sh*t.” Considering we had just been intimate I was already feeling vulnerable and him blowing me off was hurtful. He apologized and told me he didn’t think it was a big deal and he didn’t want to drive to my house (first it was the sick cat then not wanting to drive.)

We spoke on the phone and he apologized a lot then went silent when I asked him questions. Like he would talk for 5 minutes literally. He had zero emotion on the phone and it scared and frustrated me. I didn’t know what to do so I eventually said goodbye and hung up. I then texted him I wanted to end it as everything is on his terms and it makes me feel bad about myself. He ignored me so I called him again and he didn’t answer. I got upset and told him I wished I never met him. He texted me that I hurt him so badly but I was right and he is terrible. He said no one treated him as nice as I did for his whole life and he hurt me and he is sorry and asked to talk after work today. I don’t know what to do. I care about him so much but I cannot stand flakes or men who don’t do what they say. He has not been in a relationship or even on one date in 4 years and he said that he just has different “social expectations” than I do?

In addition to canceling on me twice, he will only talk on the phone if he wants to and I’m frequently unavailable because of his mental health issues. This has been affecting me because he was so sweet and loving initially and then when I open up to him he hurts me by blowing me off and then promising to take my needs into consideration but never does.