Is he attracted to me? What do you guys think?

Okay soo i lost my virginity to this guy ive been talking too for 2 years around june 1st..after the first time we talked like every day and acted like we were together like bf and gf he would have his little jealousy fits here and there and wed constantly argue and etc...then 2 months later we had again..and after the second time he became more distant..like wed still talk and what not but we allways fought about why we dont hangout more often and how he has a personality disorder/anger problem..he got so mad at me at one point that he even basicly called me fat..he told me to go eat at mcdonalds! i told him to never speak to me again but yet he called me like 2 days later acting like nothing happened. After that me and him pretty much talked on and off. Until like october we officially stopped talking. Then around november he started talking to me again about how we should hang out and what not and just sending me instant messages here and there and what not. I pretty much ignored it. but at the beginning of december he texts me and ims me about how much he wants to hang out again and have . I was like umm didnt you say i was fat? and he was like "Yeah i just said that cuz i was really mad" so whatever i forgave him.. Soo we did for the third time. After the third time i only talked too him a couple times. Its so weird why is it that he wants to hang out every once in a while? Over a 6 month period we only had three times. Is that weird? Do you think hes not attracted to me? that hes just having with me for the hell of it? I dont know what to think? What do you guys think?