@PoptartJuniper I play on the PC so I don't know if anything I can say will help on the PS4 game but..
I have noticed a couple of things about Patchy. Whenever I have a new sim in the house and want to work on the aspiration (I'm drawing a blank on the name atm, lol) involving the gardening skill, I'd been putting Patchy in the family inventory so he can't tend the garden autonomously because I want my sims to water, weed, plant, etc. to complete the milestones and level up the skill. I noticed that every time I did that, all his relationships with other family members pretty much reset every time. In most cases, you don't have to meet him again (occasionally you do), but the friendship level goes way, way down. So, since the devs added the additional 2 basement levels (total of 4 now) a while back, I haven't been putting him in the family inventory any more, I've created a room with no doors on another basement level (my gardens are on a basement level everywhere I can do that so I can grow everything year round) and put him there via a quick trip to build buy when I don't want him in the garden and then move him back to the garden after the sims have completed most of the milestones and leveled the gardening skill up some. It doesn't kill him or seem to affect his motives although you do see a lot of thought bubbles where he wants to do things. But the relationship levels don't drop anywhere as much either.
Now I do use a mod (MCCC) that alters relationship decay in my game so relationships drop much slower than an unmodded game and I prune my rel panels manually to keep them from getting too many sims in them (one of the things that will slow down the game a lot is too many relationships, easy to spot when opening the rel panel and it takes so long to populate). So that is probably affecting the relationships with Patchy when I dump him into the closed room for a while.
So you might want to try something like that and see if it works for you.