Roko’s Basilisk or Pascal’s? Thinking of Singularity Thought Experiments as Implicit Religion
Issue: Vol 20 No. 3 (2017) Special Issue: Artificial Intelligence and Religion. Guest Editor: Beth Singler
Journal: Implicit Religion
Subject Areas: Religious Studies
DOI: 10.1558/imre.35900
Abstract:
In 2010 a thought experiment speculating on the motivations and aims of a potential superintelligent Artificial Intelligence, sometimes known as the ‘Singularity’, caused uproar and anxiety on the forum board where it was initially posted. This paper considers that thought experiment’s debt to older forms of religious argument, the reactions from among the community, and how expectations about the Singularity as a being with agency can be considered to be an example of implicit religion. This is significant as the thought experiment appeared in a field of research, AI, considered by many to be secular due to its technological focus. The communities under discussion also explicitly express their aim of ‘perfecting’ human rationality, and place that ability in opposition to ‘religion’ as a derided object and the aims of ‘Goddists’ in general. This tension between overt atheism and secular communities’ return to religious tropes and narratives is relevant for the wider study of religion in the contemporary era.
Author: Beth Singler
References :
Baer, Drake. 2016. “Artificial intelligence isn’t just technology — it’s also a religion.” Tech Insider, 13th March 2016, available at http://www.techinsider.io/artificial-intelligence-has-become-religion-2016-3
Bringsjord, Selmer, Alexander Bringsjord and Paul Bello. 2012. “Vernor Vinge on Bringsjord et al.’s ‘Belief in the Singularity is Fideistic’.” In The Singularity Hypotheses: A Scientific and Philosophical Assessment, edited by A. H. Eden,
J. H. Moor, J. H Soraker and E. Steinhart, 395–412. Berlin: Springer.
ConcernedSitizen. 2015. “Slaying the Basilisk with Sitizens Mirror.” Reddit thread, 19th August 2015. https://www.reddit.com/r/rokosbasilisk/comments/3hiy8s/slaying_the_basilisk_with_sitizens_mirror/
Garcia, Phillipe. 2015. “Roko’s Basilisk Experiment.” May 2015. http://thedigitalsociology.blogspot.co.uk/2015/05/rokos-basilisk-experiment-still-writing.html
Geraci, Robert. 2010. Apocalyptic AI. Oxford: University of Oxford Press
Good, Irving. 1965. “Speculations Concerning the First Ultra-intelligent
Machine.” In Advances in Computers, edited by Franz L. Alt and Morris Rubinoff 6, 31–88. New York: Academic Press. http://web.archive.org/web/20010527181244/http://www.aeiveos.com/~bradbury/Authors/Computing/Good-IJ/SCtFUM.html
Hallquist, Chris. 2014. “Roko’s Basilisk illustrates the problems with the LessWrong community.” http://www.patheos.com/blogs/hallq/2014/12/rokos-basilisk-lesswrong/
Hokibukisa. 2015. “The Flaw of Roko’s Basilisk: Empathy and a Complete Perspective.” Reddit thread, 13th Oct 2015. https://www.reddit.com/r/rokosbasilisk/comments/3oj5zn/the_flaw_of_rokos_basilisk_empathy_and_a_complete/
Know Your Meme. 2015. “The Game.” http://knowyourmeme.com/memes/the-game
Langford, David. 1988. “BLIT.” http://www.infinityplus.co.uk/stories/blit.htm
LessWrong Wiki. 2016. “Roko’s Basilisk.” https://wiki.lesswrong.com/wiki/Roko’s_basilisk
Maslow, Abraham. 1996. “Critique of Self-Actualization Theory.” In Future
visions: The unpublished papers of Abraham Maslow, edited by E. Hoffman, 26–32. Thousand Oaks, CA: Sage.
Masson, Olivier. 2014. “Turning into Gods: Transhumanist Insight on Tomorrow’s Religiosity.” Implicit Religion 17(4): 443–458.
RationalWiki. 2016. “LessWrong.” http://rationalwiki.org/wiki/LessWrong
Roko. 2010. “Roko’s basilisk/Original Post.” deleted by LessWrong. http://rationalwiki.org/wiki/Roko%27s_basilisk/Original_post
Slate. 2014. “The Most Terrifying Thought Experiment of All Time: Why Are Techno-Futurists So Freaked Out by Roko’s Basilisk?.” http://www.slate.com/articles/technology/bitwise/2014/07/roko_s_basilisk_the_most_terrifying_thought_experiment_of_all_time.html
Yudkowsky, Eliezer. 2016. “Personal Webpage.” http://www.yudkowsky.net/
———. 2014a. “Roko’s Basilisk/ Comment by Eliezer Yudkowsky.” 4 August 2014. https://www.reddit.com/r/Futurology/comments/2cm2eg/rokos_basilisk/cjv6xa7
———. 2014b. “Eliezer_Yudkowsky comments on xkcd on the AI box experiment—LessWrong Discussion.” 21 November 2014. http://lesswrong.com/r/discussion/lw/lan/xkcd_on_the_ai_box_experiment/bnkw
———. 2011. “Transcription of Eliezer’s January 2010 video Q&A.” 14 November 2011. http://lesswrong.com/lw/8fd/transcription_of_eliezers_january_2010_video_qa/
———. 2010. “Eliezer_Yudkowsky on Solutions to the Altruists Burden: the Quantum Billionaire Trick/ EY’s Response to Roko’s Basilisk.” 24th July 2010. screenshot available at http://rationalwiki.org/wiki/File:Roko%27s_basilisk_EY_2010-06-24_23.10.png
———. 2000. “Biography.” https://web.archive.org/web/20010205221413/http://sysopmind.com/eliezer.html
Vinge, Vernor. 1981. True Names. New York: Dell.