His ex girlfriend problems. Was I right to be upset or am I just freaking out?

I think it's a common error that women want to jump on the ex's involved instead of the man, so I'll just say this... you should think of it as a WAY bigger problem that he doesn't want to talk to his family about you! If he was proud to be yours he wouldn't be making dumb excuses like "I just don't want them involved in my business" or whatever. That doesn't sound right at all.