DirectX Error crash

I play in windowed fullscreen on Win10 64-bit. 

Sometimes during gameplay the game just crashes with he following error:

---------------------------
DirectX Error
---------------------------
DirectX function "device->CreateShaderResourceView( texture->m_resource, &srvDesc, &texture->m_shaderView)" failed with DXGI_ERROR_DEVICE_REMOVED ("The video card has been physically removed from the system, or a driver upgrade for the video card has occurred. "). GPU: "", Driver: 15.8 (16.40.2311-160916a-307101E). This error is usually caused by the graphics driver crashing; try installing the latest drivers. Also, make sure you have a supported graphics card with at least 512MB.
---------------------------
OK
---------------------------

I have a brand new 8GB RX480. So VRAM is not the issue here. There are also no updates in the background that would mess with the drivers.

So this is some weird driver + game + windowed fullscreen bug, and it persists throughout different driver versions.