PS4 Pro - Performance Mode makes the game somehow look much worse

Actually, it seems that some scenes just look very bad, no matter in what mode. For example, the scene with Brov stepping forward just looks really bad, textures, lighting, it's a big difference between that one and the opening area of the game when your first control your character. 

Since it's all in the game engine, the discrepancies are quite glaring, the look very different from one second to the next. 

I still feel Performance Mode looks worse, but some things look pretty bad no matter.