Do large trays cause lag?

I don't think it does, because I've just recently cleared out everything that would be in my library (this involves the tray file) and I don't see any difference in lag or loading. I will say though that I had to adjust my game setting to cut down on the lag.