Potential Risks from Advanced Artificial Intelligence | Open Philanthropy                         @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/system/system.base.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/system/system.menus.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/system/system.messages.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/system/system.theme.css?q7b2rf");   @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/jquery_update/replace/ui/themes/base/minified/jquery.ui.core.min.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/jquery_update/replace/ui/themes/base/minified/jquery.ui.theme.min.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/jquery_update/replace/ui/themes/base/minified/jquery.ui.accordion.min.css?q7b2rf");   @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/comment_notify/comment_notify.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/comment/comment.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/date/date_api/date.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/date/date_popup/themes/datepicker.1.7.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/field/theme/field.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/footnotes/footnotes.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/custom/grants_summary/grants_summary.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/node/node.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/search/search.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/modules/user/user.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/views/css/views.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/caption_filter/caption-filter.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/ckeditor/css/ckeditor.css?q7b2rf");   @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/ctools/css/ctools.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/typogrify/typogrify.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/content_type_extras/css/content_type_extras.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/modules/contrib/print/print_ui/css/print_ui.theme.css?q7b2rf");   @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/global/normalize.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/global/op-fonts.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/global/html.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/global/meanmenu.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/global/global.css?q7b2rf"); @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/pages/pages.css?q7b2rf");   @import url("https://web.archive.org./web/20200411200916cs_/https://www.openphilanthropy.org/sites/all/themes/op_basic/styles/css/global/admin.css?q7b2rf");                                      Jump to Navigation            Research & IdeasCause Selection Notable Lessons Cause Reports Conversations History of Philanthropy  Focus AreasU.S. Policy Criminal Justice Reform Farm Animal Welfare Macroeconomic Stabilization Policy Immigration Policy Land Use Reform Global Catastrophic Risks Biosecurity and Pandemic Preparedness Potential Risks from Advanced Artificial Intelligence Scientific Research Global Health & Development Other areas  GivingGrants Database Current Priorities Guide for Grant Seekers Grantmaking Stages  About UsWho We Are Vision & Values Openness Progress to Date Team Press Kit  Blog Get InvolvedContact Us Jobs Stay Updated          Search form  Search                     Home / Focus Areas / Global Catastrophic Risks  Potential Risks from Advanced Artificial Intelligence      FacebookTwitterPrintSaveRSSEmail                   It appears possible that the coming decades will see substantial progress in artificial intelligence, potentially even to the point where machines come to outperform humans in many or nearly all intellectual domains, though it is difficult or impossible to make confident forecasts in this area. These advances could lead to extremely positive developments, but could also potentially pose risks from misuse, accidents, or harmful societal effects, which could plausibly reach the level of global catastrophic risks. We’re interested in supporting technical research that could reduce the risk of accidents, as well as strategic and policy work that has the potential to improve society’s preparedness for major advances in AI.

 For more on why we consider this an important cause, see Potential Risks from Advanced Artificial Intelligence: The Philanthropic Opportunity (May 2016). Also see our process for selecting focus areas.

 Illustrative grants A complete list of our grants in the area of potential risks from artificial intelligence can be found here. Grants include:

 Georgetown University — Center for Security and Emerging Technology UC Berkeley — Center for Human-Compatible AI Ought — General Support GoalsRL — Workshop on Goal Specifications for Reinforcement Learning Machine Intelligence Research Institute — General Support OpenAI — General Support Other content The Open Phil AI Fellowship Blog post: Potential risks from advanced artificial intelligence: the philanthropic opportunity Blog post: Some background on our views regarding advanced artificial intelligence Public cause report (August 2015) used in our process for selecting focus areas What should we learn from past AI forecasts? What do we know about AI timelines? Blog post: Concrete Problems in AI Safety   Daniel Dewey

 Daniel Dewey leads Open Philanthropy’s work on supporting technical research to mitigate potential risks from advanced artificial intelligence. Daniel graduated from Carnegie Mellon University in 2008 with a BS in Computer Science and Philosophy. He subsequently worked at Google and the Future of Humanity Institute, contracted with the Future of Life Institute and the Centre for Effective Altruism, and joined Open Philanthropy in 2015. 

                          contact us jobs press kit  facebook twitter rss © Open Philanthropy. Except as otherwise noted, this work is licensed under a Creative Commons Attribution-Noncommercial-ShareAlike 3.0 United States License. Some images may be copyrighted by others and not licensed for re-use: see image captions or footnotes. Privacy policy         try { clicky.init(100914494); }catch(e){}