The Intro to AI Safety curriculum provides a high-level understanding of the problems in AI safety and some of the key research directions which aim to solve it. Students will learn about the theoretical and practical risks associated with using advanced AI systems, the difficulties inherent to addressing them, and the current state of research regarding solutions.

This course assumes fluency with linear algebra, multivariable calculus, and basic programming at a level equivalent to MATH 54, MATH 53, and CS 61A. Since the class will quickly move through the material and involve significant ML paper reading, familiarity with machine learning at the level of CS 189 is strongly recommended. Prior familiarity with the field of AI Safety is not required.

Students will receive credit based on attendance, completion of weekly reading and coding projects. Attendance is mandatory at weekly meetings, with a maximum of two unexcused absences allowed. Staff will be accommodating regarding reasons for absences. Weekly readings reflections must be completed, requiring students to engage with assigned readings and briefly write about related questions and comments. Coding projects will focus on replicating ideas from research papers and may be completed in groups. There will be two to three projects in total, depending on the time spent on the first one.

Please fill out the application here: tinyurl.com/BasisTechDecal. We will accommodate as many students as possible but will prioritize those with a particular interest in AI safety who meet the prerequisites.