Camera stuck following sim

I don’t even know how or why the camera started following my active sim but here we are. It’s stuck following the sim and pinging back to the active sim whenever I try to move the camera away. 

Right clicking on the sims portrait does nothing except making a little camera icon appear and disappear. It doesn’t turn the camera follow off.