Fast forward won't stay on for more than a few seconds

I can't find a recent thread on this or an old one with a good solution. Out of nowhere my game suddenly will not stay on fast forward. It will toggle back to play after a few seconds. I'm not sure if this is a bug issue or something specific to my game. Any advice that could help would be appreciated! I'm not a live speed for everything type of player.

Also after more play I've noticed it doesn't happen ALL of the time. I'm playing the same household on the same lot the whole time and sometimes the FF works and sometimes it toggles off like I stated above. I haven't found a correlation between the times in happens yet though.