XBOX Matchmaking taking too long

Team, i sometimes need to wait for more than 20 min just get in. Matchmaking is severely broken. It shows 30 people in and all of a sudden it resets to 01 and starts-over. This happens multiples times for a single gameplay session. Its happening right now especially after 23:00 (IST), I can never get into a single game. Just shows 18 players in queue and goes to 30 and comes back to 4. 

This is disappointing and I'm about to give up.