Is there any way to turn off alien abductions?

You could lock the doors (or put furniture in front of them) between 9 pm and 4 am. That way, your Sim won't be able to walk outside to investigate the light. I don't think it's possible to cancel the action unless you have MCCC.