Difference between revisions of "The Hanson-Yudkowsky AI-Foom Debate"

From Lesswrongwiki
Jump to: navigation, search
m (moved "Debating Yudkowsky" post by Robin from the JS debate section to the postscript)
(Put the ebook first)
Line 1: Line 1:
In late 2008, an extensive and long-awaited debate about the [[Technological Singularity]] occurred on [[Overcoming Bias]], mainly between [[Robin Hanson]] and [[Eliezer Yudkowsky]]. It focused on the likelihood of [[hard takeoff|hard AI takeoff]] ("[[FOOM]]"), the need for a theory of [[Friendly AI|Friendliness]], and the future of [[AGI]], [[whole brain emulation]], and [[recursive self-improvement]] in general.  A stand-up debate on the same themes took place at ''Jane Street Capital'' on Wednesday June 30 2011.  A full transcript of the debate is available [https://docs.google.com/document/pub?id=17yLL7B7yRrhV3J9NuiVuac3hNmjeKTVHnqiEa6UQpJk here].
+
In late 2008, an extensive and long-awaited debate about the [[Technological Singularity]] occurred on [[Overcoming Bias]], mainly between [[Robin Hanson]] and [[Eliezer Yudkowsky]]. It focused on the likelihood of [[hard takeoff|hard AI takeoff]] ("[[FOOM]]"), the need for a theory of [[Friendly AI|Friendliness]], and the future of [[AGI]], [[whole brain emulation]], and [[recursive self-improvement]] in general.  A stand-up debate on the same themes took place at ''Jane Street Capital'' in June 2011.
  
An incomplete summary and analysis of the text debate is available [http://lesswrong.com/lw/fih/a_summary_of_the_hansonyudkowsky_foom_debate/ here].
+
The best resource for most readers new to the debate will be [[MIRI]]'s 2013 [http://intelligence.org/ai-foom-debate/ The Hanson-Yudkowsky AI-Foom Debate eBook], available in PDF, EPUB, and MOBI formats. This includes
  
The posts constituting this debate have been collected here to make it easier to follow for future audiences, alongside links to the Jane Street debate.
+
* the original series of blog posts,
 +
* a transcript of the 2011 debate
 +
* Kaj Sotala's summary and analysis of the debate, and
 +
* a 2013 technical report on AI takeoff dynamics (“intelligence explosion microeconomics”) written by Yudkowsky.
  
 
==Prologue==
 
==Prologue==
Line 77: Line 80:
  
 
==Jane Street debate==
 
==Jane Street debate==
 +
 +
A stand-up debate between Hanson and Yudkowsky on the same themes took place on Wednesday June 30 2011 at ''Jane Street Capital''.
  
 
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011vid.wmv Video with better quality audio] 1.57G
 
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011vid.wmv Video with better quality audio] 1.57G
 
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011.WMA Poor quality WMA audio] 97M
 
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011.WMA Poor quality WMA audio] 97M
 
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011.mp3 Poor quality MP3 audio] 97M
 
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011.mp3 Poor quality MP3 audio] 97M
* [https://docs.google.com/document/pub?id=17yLL7B7yRrhV3J9NuiVuac3hNmjeKTVHnqiEa6UQpJk Full Transcript]
+
* [https://docs.google.com/document/pub?id=17yLL7B7yRrhV3J9NuiVuac3hNmjeKTVHnqiEa6UQpJk Full transcript]
 
* [http://lesswrong.com/lw/bug/partial_transcript_of_the_hansonyudkowsky_june/ Partial transcript] by Chris Hallquist
 
* [http://lesswrong.com/lw/bug/partial_transcript_of_the_hansonyudkowsky_june/ Partial transcript] by Chris Hallquist
  
==eBook==
+
==Draft summary and analysis==
An eBook version of the debate is available in various formats (PDF, EPUB, and MOBI) [http://intelligence.org/ai-foom-debate/ here]. It contains:
 
  
* the original series of blog posts,
+
In Spring 2012 [[Luke Muehlhauser]] asked [[Kaj Sotala]] to write a summary and analysis of the debate; he made a [http://lesswrong.com/lw/fih/a_summary_of_the_hansonyudkowsky_foom_debate/ draft of that analysis] available in November 2012.
* a transcript of a 2011 in-person debate between Hanson and Yudkowsky,
 
* a summary of the debate written by Kaj Sotala, and
 
* a 2013 technical report on AI takeoff dynamics (“intelligence explosion microeconomics”) written by Yudkowsky.
 
  
 
==See also==
 
==See also==

Revision as of 20:23, 9 September 2013

In late 2008, an extensive and long-awaited debate about the Technological Singularity occurred on Overcoming Bias, mainly between Robin Hanson and Eliezer Yudkowsky. It focused on the likelihood of hard AI takeoff ("FOOM"), the need for a theory of Friendliness, and the future of AGI, whole brain emulation, and recursive self-improvement in general. A stand-up debate on the same themes took place at Jane Street Capital in June 2011.

The best resource for most readers new to the debate will be MIRI's 2013 The Hanson-Yudkowsky AI-Foom Debate eBook, available in PDF, EPUB, and MOBI formats. This includes

  • the original series of blog posts,
  • a transcript of the 2011 debate
  • Kaj Sotala's summary and analysis of the debate, and
  • a 2013 technical report on AI takeoff dynamics (“intelligence explosion microeconomics”) written by Yudkowsky.

Prologue

Main sequence

Conclusion

Postscript

Jane Street debate

A stand-up debate between Hanson and Yudkowsky on the same themes took place on Wednesday June 30 2011 at Jane Street Capital.

Draft summary and analysis

In Spring 2012 Luke Muehlhauser asked Kaj Sotala to write a summary and analysis of the debate; he made a draft of that analysis available in November 2012.

See also