Artificial Intelligence · AI Alignment & Safety
A topic within AI Alignment & Safety, itself one of 11 topics in that field and part of Artificial Intelligence.
2 works
Hendrycks & Mazeika
Adapts standard tools from safety engineering and risk analysis in other high-stakes industries to structure how AI researchers should reason about and prioritise catastrophic and existential risks from AI.
24 pageslink checked 17 Sept 2026Nick Bostrom
Argues intelligence and final goals are independent (the orthogonality thesis), and that agents with almost any final goal will converge on similar instrumental subgoals — self-preservation, resource acquisition, goal-content integrity — which is what makes a highly capable system's specific goal so consequential.
15 pageslink checked 17 Sept 2026