AI safety

Description of Safety Concerns

Medium-term Risks

• 2023-04: A.I. Dilemma – Tristan Harris and Aza Raskin” (video) (.website-files.com/5f0e1294f002b1bb26e1f304/64224a9051a6637c1b60162a_65-your-undivided-attention-The-AI-Dilemma-transcript.pdf podcast transcript): raises concern about human ability to handle these transformations
• 2023-04: Daniel Schmachtenberger and Liv Boeree (video): AI could accelerate perverse social dynamics

Long-term (x-risk)

• Instrumental Convergence

Learning Resources

• DeepMind short course on AGI safety

Research

• 2023-04: Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark