The only herbs I routinely consider growing and keeping are wonderpetal and peppermint. Wonderpetal helps academic performance at university and since I routinely send sims to get a degree having perfect quality wonderpetal is helpful. I will occasionally use peppermint in cooking with the Cook With Any Ingredient mod so that the dishes in which I include peppermint give a nice moodlet.
The only coffee bean I routinely grow in my games is the red berry bean since it's worth so much - it makes a great cash crop.
edit: I forgot about ginseng. All my households grow that now to make double-boiled ginseng broth from the canning station overhaul mod. The broth cures the 'germy' moodlet. I usually use the Swift-Gro gardening station for that (and the slower herbs) so it doesn't take so long.