Relationship advice plsssssssssssss?

Now me and my boy friend ve been going around for three years everythings fine but the moment he's with his family he totally forgets that I exist.. I just feel bad that does not even bother callin or mssagin.. and worst when i call him he makes me feel bad by telling that I am not happy for him which is really not the fact.. i love him n i wud love to see him happy always.. i honestly feel like a dirt bag i love this guy so much but what i get back is just crap..... I don want leave him but how do i figure this out