So you removed the entire mods folder and cleaned your caches and still had the freezing (that especially has been reported by others as being mod related) ?
Could you try renaming your entire user folder and start a new game for testing purposes to see if that also has the issue ?
Detailed instructions can be found here: http://answers.ea.com/t5/The-Sims-4/FAQ-Troubleshooting-Steps-amp-Known-Issues/m-p/3621199
You won't loose anything. Just make sure to not delete any files and make a backup.
Try on a new game with nothing added back first (start new game). If it works, put back your save game and try again. If it still works, you can start putting stuff back.
- Options.ini (or just re-set all your settings manually)
- Tray Folder
- Screenshots/Videos/Custom music
- Rest of the save games (leave out slot_00000001.save which is the autosave)
- Custom content like clothing, hair, skins, make up ....
- Mods (one by one, making sure they all still work)
The rest does not need putting back, cause they are mostly cache files that recreate or log files that are not needed for the game.