Sims 3 - Island Paradise: Reconstructing the uncharted island map?

Okay. My two Sims each have two map pieces, so I have all four, but it won't let me reconstruct the map because I can't take two map pieces out of one of my Sims' inventory and give them to my other ...