I have had this happen multiple times in my current legacy (currently on 3rd gen., long lifespan.) I hadn't realized it at first as they knew a lot of other sims. What made me notice it was in my second gen. when the dad had completely forgotten their dog who had died; the father had the highest relationship with the dog, but everyone else in the household had remembered the dog when it came back as a ghost. After this I started to notice they were forgetting many sims- their daughters friends who visited often, some of their lower acquaintances, relatives (the grandmother), and even friends.
Soon after their teenager moved out with her friends, and I have only noticed a couple forgotten sims. But admittedly haven't paid much attention to it as they are busy and don't socialize much. They have forgotten some peers they go to high school with.
At the time I did not have any mods installed, but I have two now. I have all packs except for Journey to Batuu and most of the kits.