Romantic Relationships decay/become negative fast with no interaction

I am playing with the new expansion pack Lovestruck. My sim started seeing another sim as a partner. Every time I do a romantic social, the romance bar will go up, then start depleting so fast it's l...