Power off button interference with game controls

A button off button just popped off from nowhere, located near the game controls and refused to go, even after shutting off the game. It interferes with the game and is as annoying as anything. How do I make it go?