Possibility of Superintelligence possessing Universal Altruism

Abstract

If a superintelligence significantly exceeds human intelligence, it could dominate the world, potentially relegating humanity to a subordinate role. However, if such a superintelligence possesses a universal sense of altruism and ethics, human welfare will likely be preserved. This ethical perspective values all sentient beings, including humans, irrespective of their utility to superintelligence. While Bostrom's orthogonality hypothesis suggests that superintelligence may not inherently possess universal altruism, fostering this quality is crucial for a future where humans and superintelligence can coexist and thrive. This study examines two pathways through which superintelligence might develop universal altruism: firstly, by ensuring its survival within society, and secondly, through autonomous value exploration. In conclusion, acquiring an ethical stance that prioritizes the welfare of all sentient beings by superintelligence can be a realistic and promising prospect.