Voice chat remains on after turning it off in the options on Xbox One

Basically what the title says. When you turn off voice chat in the options and you attempt to speak through a headset, it still shows yourself speaking (IE: your username pops up on screen with a lit...