Microphone always used at start of games.

I have push to talk set but almost every time I join a game it uses my mic for about 1-3 seconds before stopping, I am not pressing the talk button when this happens.