BI 098 Brian Christian: The Alignment Problem
Brian and I discuss a range of topics related to his latest book, The Alignment Problem: Machine Learning and Human Values. The alignment problem asks how we can build AI that does what we want it to do, as opposed to building AI that will compromise our own values by accomplishing tasks that may be harmful or dangerous to us. Using some of the stories Brain relates in the book, we talk about: The history of machine learning and how we got this point;Some methods researches are creating to understand what’s being represented in neural nets and how they generate their output;Some modern proposed solutions to the alignment problem, like programming the machines to learn our preferences so they can help achieve those preferences – an idea called inverse reinforcement learning;The thorny issue of accurately knowing our own values- if we get those wrong, will machines also get it wrong? Links: Brian’s website.Twitter: @brianchristian.The Alignment Problem: Machine Learning and Human Values.Related papersNorbert Wiener from 1960: Some Moral and Technical Consequences of Automation. Timestamps:4:22 – Increased work on AI ethics8:59 – The Alignment Problem overview12:36 – Stories as important for intelligence16:50 – What is the alignment problem17:37 – Who works on the alignment problem?25:22 – AI ethics degree?29:03 – Human values31:33 – AI alignment and evolution37:10 – Knowing our own values?46:27 – What have learned about ourselves?58:51 – Interestingness1:00:53 – Inverse RL for value alignment1:04:50 – Current progress1:10:08 – Developmental psychology1:17:36 – Models as the danger1:25:08 – How worried are the experts?