Difference between revisions of "The Hanson-Yudkowsky AI-Foom Debate"

From Lesswrongwiki
Jump to: navigation, search
(Mention and link to Jane Street Debate and Sotala summary)
Line 1: Line 1:
In late 2008, an extensive and long-awaited debate about the [[Technological Singularity]] occurred on [[Overcoming Bias]], mainly between [[Robin Hanson]] and [[Eliezer Yudkowsky]]. It focused on the likelihood of [[hard takeoff|hard AI takeoff]] ("[[FOOM]]"), the need for a theory of [[Friendly AI|Friendliness]], and the future of [[AI]], [[brain emulations]], and [[recursive improvement]] in general. This debate is often used to illustrate the difficulty of resolving [[disagreement|disagreements]], even among expert rationalists.
+
In late 2008, an extensive and long-awaited debate about the [[Technological Singularity]] occurred on [[Overcoming Bias]], mainly between [[Robin Hanson]] and [[Eliezer Yudkowsky]]. It focused on the likelihood of [[hard takeoff|hard AI takeoff]] ("[[FOOM]]"), the need for a theory of [[Friendly AI|Friendliness]], and the future of [[AI]], [[brain emulations]], and [[recursive improvement]] in general. A stand-up debate on the same themes took place at ''Jane Street Capital'' on Wednesday June 30 2011.  [[Kaj Sotala]] made available an [http://lesswrong.com/lw/fih/a_summary_of_the_hansonyudkowsky_foom_debate/ incomplete draft summary and analysis] of the debate in November 2012.
  
The posts constituting this debate have been collected here to make it easier to follow for future audiences.
+
This debate is often used to illustrate the difficulty of resolving [[disagreement|disagreements]], even among expert rationalists.
 +
 
 +
The posts constituting this debate have been collected here to make it easier to follow for future audiences, alongside links to the Jane Street debate.
  
 
==Prologue==
 
==Prologue==
Line 61: Line 63:
  
 
==Conclusion==
 
==Conclusion==
 
+
 
* [http://www.overcomingbias.com/2008/12/what-core-argument.html What Core Argument?] by [[Robin Hanson]]
 
* [http://www.overcomingbias.com/2008/12/what-core-argument.html What Core Argument?] by [[Robin Hanson]]
 
* [http://lesswrong.com/lw/wp/what_i_think_if_not_why/ What I Think, If Not Why] by [[Eliezer Yudkowsky]]
 
* [http://lesswrong.com/lw/wp/what_i_think_if_not_why/ What I Think, If Not Why] by [[Eliezer Yudkowsky]]
Line 70: Line 72:
 
* [http://www.overcomingbias.com/2008/12/we-agree-get-froze.html We Agree: Get Froze] by [[Robin Hanson]]
 
* [http://www.overcomingbias.com/2008/12/we-agree-get-froze.html We Agree: Get Froze] by [[Robin Hanson]]
 
* [http://lesswrong.com/lw/wq/you_only_live_twice/ You Only Live Twice] by [[Eliezer Yudkowsky]]
 
* [http://lesswrong.com/lw/wq/you_only_live_twice/ You Only Live Twice] by [[Eliezer Yudkowsky]]
 +
 +
==Jane Street debate==
 +
 +
* [http://www.overcomingbias.com/2011/07/debating-yudkowsky.html Debating Yudkowsky] by [[Robin Hanson]]
 +
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011vid.wmv Video with better quality audio] 1.57G
 +
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011.WMA Poor quality WMA audio] 97M
 +
* [http://hanson.gmu.edu/ppt/JaneStreetDebate2011.mp3 Poor quality MP3 audio] 97M
 +
* [http://lesswrong.com/lw/bug/partial_transcript_of_the_hansonyudkowsky_june/ Partial transcript] by Chris Hallquist
  
 
==See also==
 
==See also==

Revision as of 08:29, 24 November 2012

In late 2008, an extensive and long-awaited debate about the Technological Singularity occurred on Overcoming Bias, mainly between Robin Hanson and Eliezer Yudkowsky. It focused on the likelihood of hard AI takeoff ("FOOM"), the need for a theory of Friendliness, and the future of AI, brain emulations, and recursive improvement in general. A stand-up debate on the same themes took place at Jane Street Capital on Wednesday June 30 2011. Kaj Sotala made available an incomplete draft summary and analysis of the debate in November 2012.

This debate is often used to illustrate the difficulty of resolving disagreements, even among expert rationalists.

The posts constituting this debate have been collected here to make it easier to follow for future audiences, alongside links to the Jane Street debate.

Prologue

Main sequence

Conclusion

Postscript

Jane Street debate

See also