Referee always points the wrong way

The referee always points the wrong way for a foul, happened in FIFA 23 too. The referee points to the penalty spot, only for it to be a free kick taken by the GK. Or they point for a free kick, only for it to be a penalty. Happens everywhere on the pitch. The linesmen point in the correct direction though.