Anxious in Love

My boyfriend (23) and I (22) have been together for 4 years now. I have had anxiety throughout the entire relationship and it has made our relationship challenging. When we first started dating up until about 2 years, he was the most kind, loving and supportive boyfriend ever. He went to appointments with me, stayed in the hospital with me, etc. but as our relationship continued things got harder. I am diagnosed with generalized anxiety disorder and it has created many doubts and insecurities within or relationship. Recently, I stopped taking my medication (which I have done before and it has not turned out well). At first I was fine, but the last two weeks have been none stop anxiety. I have questioned everything in our relationship. Everything he says or does and for the life of me am not able to let it go. For about two weeks, He was so patient and considerate of my situation. He would make me feel better and reassure me, but a couple of days ago, I had not let something go, (after having multiple problems already), he got upset and told me that I needed to stop because he was close to almost hating me. I understand his frustration and how hard this has been on him, but I can’t seem to get over the almost hating me part. I just wonder if any one else has gone through this in their relationship. I just don’t know if this is a normal reaction for someone who is overworked and tired of dealing with this 24/7 or if I need to find someone else to be with.