Forethought published an article examining the benefits and risks of having a superintelligent AI called a nightwatchman aboard probes leaving the solar system during future galactic colonization.

How should we navigate explosive AI progress? AI is already accelerating innovation, and might supercharge it in the future. This might lead to economic abundance and better collective decision-making, or to AI-enabled dictatorships and new bioweapons. We are a research nonprofit asking: how can we reach as good an outcome as possible? And what can we do, now, to prepare?