@LittleGraveRaven There are a few places you can go from here. One is to try an older graphics driver, not the WHQL one you previously installed and not the one you had before that. I don't think the driver itself is incompatible with Sims 4, I mean we'd see a lot of other reports, but that driver wasn't loaded in safe mode, so it's a reasonable test. You can find older drivers here:
https://www.amd.com/en/support/previous-drivers/graphics/amd-radeon-5700-series/amd-radeon-rx-5700-series/amd-radeon-rx-5700-xt
Please only try WHQL drivers rather than the optional ones. You'll need to DDU your current one any time you want to install an older version, but not the other way around, so you may want to start with the oldest you're comfortable using and work your way forwards.
A completely different direction would be to do some hardware monitoring. Hardware issues don't usually produce the errors you're seeing, but it's easy enough to try. If you want to, download hwinfo from here:
https://www.hwinfo.com/download/
You don't need to install anything if you don't want to; just choose the Portable version, unzip it, and launch it from Downloads or wherever you want. (If you would like to install, be sure to click the button for hwinfo itself, not for lansweeper.) Restart your computer, and don't open any other apps. Launch hwinfo, choose "sensors only," and click the icon that's a sheet of paper with a + sign to start logging. Save the file to your desktop for easy access later.
Wait five minutes, then launch Sims 4 and play until it crashes. Click the same button to end logging. Then upload the log to a third-party free filehosting site and link it here. Please leave it in .csv format, or if you use OneDrive to share, please compress it in .zip format instead.