Esc key doesn't work

For the record my esc key works. There is nothing wrong with it. I have tested in multiple places.

1. The esc key occassionaly works in game. I can spam it and it will work 1 out of 5 times (something like that)
2. The esc key NEVER works when I hold it down

This means that I am completely unable to unbind keys.