Five themes in AI safety work. Each has guided projects, project ideas, mentored research and reading.
Testing, understanding and controlling AI systems.
Technical AI safety covers evaluating how models behave, interpretability (studying what happens inside them), and training and oversight methods that keep models honest and controllable as they become more capable.
7 guided projects · 16 projects · 157 mentored projects
View technical projectsPreventing and preparing for severe pandemics, including ones made easier by AI.
Biosecurity work includes cleaner indoor air, better protective equipment, earlier detection of outbreaks and screening of DNA synthesis orders. AI matters here because it could make dangerous biological knowledge easier to access, and because it can also strengthen defences.
8 guided projects · 26 projects · 7 mentored projects
View biosecurity projectsOversight of the most capable AI systems, the companies that build them and the chips they run on.
A small number of companies build the most capable AI models, using very large amounts of specialised computing hardware (“compute”). Frontier AI governance looks at how these companies and their models can be overseen: safety commitments, audits, export controls on chips and international agreements that can be verified.
6 guided projects · 17 projects · 35 mentored projects
View governance projectsLaws, institutions and public debate about AI.
AI policy covers the rules governments make about AI, such as the EU AI Act, national AI safety institutes, public-sector use of algorithms and liability for harm. It also covers wider effects on jobs, elections and the balance of power.
7 guided projects · 18 projects · 20 mentored projects
View policy projectsValues, moral status, agency and what a good outcome looks like.
Building safe AI raises philosophical questions: whose values a system should follow when people disagree, whether AI systems could have moral status, when it’s fair to say a model “believes” something, and what a good long-term outcome would be.
5 guided projects · 26 projects · 9 mentored projects
View philosophy projects