Part of the goal of this system is to push for full guilds, as those are "healther" for the game and less likely to fall apart if something happens, i.e.- a handful of players leave.
As for fair, isnt it more work to get and keep 50 players working together than it is to keep less?
Sure the individual effort is the same, but guilds work very hard to keep themselves full (at 50) with active participating members, and as a "reward" they get to raid at maximum efficiency. That seems fair, and thinking it should be that way doesnt seem selfish.