Item Details

Roko’s Basilisk or Pascal’s? Thinking of Singularity Thought Experiments as Implicit Religion

Issue: Vol 20 No. 3 (2017) Special Issue: Artificial Intelligence and Religion. Guest Editor: Beth Singler

Journal: Implicit Religion

Subject Areas: Religious Studies

DOI: 10.1558/imre.35900

Abstract:

In 2010 a thought experiment speculating on the motivations and aims of a potential superintelligent Artificial Intelligence, sometimes known as the ‘Singularity’, caused uproar and anxiety on the forum board where it was initially posted. This paper considers that thought experiment’s debt to older forms of religious argument, the reactions from among the community, and how expectations about the Singularity as a being with agency can be considered to be an example of implicit religion. This is significant as the thought experiment appeared in a field of research, AI, considered by many to be secular due to its technological focus. The communities under discussion also explicitly express their aim of ‘perfecting’ human rationality, and place that ability in opposition to ‘religion’ as a derided object and the aims of ‘Goddists’ in general. This tension between overt atheism and secular communities’ return to religious tropes and narratives is relevant for the wider study of religion in the contemporary era.

Author: Beth Singler

View Original Web Page

References :

Baer, Drake. 2016. “Artificial intelligence isn’t just technology — it’s also a religion.” Tech Insider, 13th March 2016, available at http://www.techinsider.io/artificial-intelligence-has-become-religion-2016-3

Bringsjord, Selmer, Alexander Bringsjord and Paul Bello. 2012. “Vernor Vinge on Bringsjord et al.’s ‘Belief in the Singularity is Fideistic’.” In The Singularity Hypotheses: A Scientific and Philosophical Assessment, edited by A. H. Eden,
J. H. Moor, J. H Soraker and E. Steinhart, 395–412. Berlin: Springer.

ConcernedSitizen. 2015. “Slaying the Basilisk with Sitizens Mirror.” Reddit thread, 19th August 2015. https://www.reddit.com/r/rokosbasilisk/comments/3hiy8s/slaying_the_basilisk_with_sitizens_mirror/

Garcia, Phillipe. 2015. “Roko’s Basilisk Experiment.” May 2015. http://thedigitalsociology.blogspot.co.uk/2015/05/rokos-basilisk-experiment-still-writing.html

Geraci, Robert. 2010. Apocalyptic AI. Oxford: University of Oxford Press

Good, Irving. 1965. “Speculations Concerning the First Ultra-intelligent
Machine.”
In Advances in Computers, edited by Franz L. Alt and Morris Rubinoff 6, 31–88. New York: Academic Press. http://web.archive.org/web/20010527181244/http://www.aeiveos.com/~bradbury/Authors/Computing/Good-IJ/SCtFUM.html

Hallquist, Chris. 2014. “Roko’s Basilisk illustrates the problems with the LessWrong community.” http://www.patheos.com/blogs/hallq/2014/12/rokos-basilisk-lesswrong/

Hokibukisa. 2015. “The Flaw of Roko’s Basilisk: Empathy and a Complete Perspective.” Reddit thread, 13th Oct 2015. https://www.reddit.com/r/rokosbasilisk/comments/3oj5zn/the_flaw_of_rokos_basilisk_empathy_and_a_complete/

Know Your Meme. 2015. “The Game.” http://knowyourmeme.com/memes/the-game

Langford, David. 1988. “BLIT.” http://www.infinityplus.co.uk/stories/blit.htm

LessWrong Wiki. 2016. “Roko’s Basilisk.” https://wiki.lesswrong.com/wiki/Roko’s_basilisk

Maslow, Abraham. 1996. “Critique of Self-Actualization Theory.” In Future
visions: The unpublished papers of Abraham Maslow
, edited by E. Hoffman, 26–32. Thousand Oaks, CA: Sage.

Masson, Olivier. 2014. “Turning into Gods: Transhumanist Insight on Tomorrow’s Religiosity.” Implicit Religion 17(4): 443–458.

RationalWiki. 2016. “LessWrong.” http://rationalwiki.org/wiki/LessWrong

Roko. 2010. “Roko’s basilisk/Original Post.” deleted by LessWrong. http://rationalwiki.org/wiki/Roko%27s_basilisk/Original_post

Slate. 2014. “The Most Terrifying Thought Experiment of All Time: Why Are Techno-Futurists So Freaked Out by Roko’s Basilisk?.” http://www.slate.com/articles/technology/bitwise/2014/07/roko_s_basilisk_the_most_terrifying_thought_experiment_of_all_time.html

Yudkowsky, Eliezer. 2016. “Personal Webpage.” http://www.yudkowsky.net/

———. 2014a. “Roko’s Basilisk/ Comment by Eliezer Yudkowsky.” 4 August 2014. https://www.reddit.com/r/Futurology/comments/2cm2eg/rokos_basilisk/cjv6xa7

———. 2014b. “Eliezer_Yudkowsky comments on xkcd on the AI box experiment—LessWrong Discussion.” 21 November 2014. http://lesswrong.com/r/discussion/lw/lan/xkcd_on_the_ai_box_experiment/bnkw

———. 2011. “Transcription of Eliezer’s January 2010 video Q&A.” 14 November 2011. http://lesswrong.com/lw/8fd/transcription_of_eliezers_january_2010_video_qa/

———. 2010. “Eliezer_Yudkowsky on Solutions to the Altruists Burden: the Quantum Billionaire Trick/ EY’s Response to Roko’s Basilisk.” 24th July 2010. screenshot available at http://rationalwiki.org/wiki/File:Roko%27s_basilisk_EY_2010-06-24_23.10.png

———. 2000. “Biography.” https://web.archive.org/web/20010205221413/http://sysopmind.com/eliezer.html

Vinge, Vernor. 1981. True Names. New York: Dell.