[Question] How to safely remove mods?

As I mentioned in this comment, I recently installed a mod. I don't normally play with them, and I want to make sure I can safely remove it to update my game. Do I just delete it from my folder and re...