I would advise not trying to recruit random people who ally you because they beat you in the arena.
Use the guild subforums to find people. Have it clearly in mind what you want to do with your guild now, and where you want to go. Be realistic about how and who you recruit (don't say "we're almost heroic AAT" if you are barely managing heroic Rancor), and don't expect to be carried (the guild leader is usually somewhere around the top of the raid leaderboard, does his 600 coins and contributes to donations, etc.)
If you can't be bothered to lead a guild like that, then disband and join someone else's.
There are plenty of guilds that potter around going nowhere. There is nothing wrong with that. But it won't get you anywhere in raids.