Xbox cannot accept game invites from a party he is part of or invite friend

I am on a XBox One and I can join XBox parties but invites to games from others in the party (owners or just other members) appear and when I hit the xbox button the controller vibrates like it is acknowledging the acceptance but then nothing happens.  Also when I click on Invite Friends, nothing happens.  How do I fix this?  I used to be able to accept invites btw.  Not sure if its an update thing or what.