Bibliography

Every source cited in AI Safety Atlas: 963 references, by label.

  1. 1985 — cited in Chapter 4: Governance
  2. 1a3orn, 2023 — cited in Chapter 3: Strategies
  3. Aarne et al., 2024 — cited in Chapter 4: Governance
  4. Abid et al., 2021 — cited in Chapter 6: Specification Gaming
  5. Abraham, 2024 — cited in Chapter 2: Risks
  6. Adan et al., 2024 — cited in Chapter 4: Governance
  7. Aguirre, 2025 — cited in Chapter 2: Risks
  8. Aguirre, 2025 — cited in Chapter 3: Strategies
  9. AI Digest, 2023 — cited in Chapter 1: Capabilities
  10. AI Digest, 2024 — cited in Chapter 5: Evaluations
  11. AI Impacts, 2022 — cited in Chapter 1: Capabilities
  12. AI Impacts, 2022 — cited in Chapter 1: Capabilities
  13. AI Incident Database, 2025 — cited in Chapter 2: Risks
  14. AI Index Report, 2025 — cited in Chapter 1: Capabilities
  15. AI Optimists, 2023 — cited in Chapter 3: Strategies
  16. AI Safety in China, 2025 — cited in Chapter 4: Governance
  17. AISI, 2025 — cited in Chapter 3: Strategies
  18. Akash, 2023 — cited in Chapter 3: Strategies
  19. Alexander, 2023 — cited in Chapter 3: Strategies
  20. Althaus & Gloor, 2016 — cited in Chapter 2: Risks
  21. Altman, 2023 — cited in Chapter 1: Capabilities
  22. Amazon, 2023 — cited in Chapter 1: Capabilities
  23. Amazon, 2025 — cited in Chapter 1: Capabilities
  24. Ammann, 2025 — cited in Chapter 3: Strategies
  25. Amodei, 2023 — cited in Chapter 1: Capabilities
  26. Anderljung et al. 2024 — cited in Chapter 4: Governance
  27. Anderljung et al., 2023 — cited in Chapter 3: Strategies, Chapter 4: Governance
  28. Anderljung et al., 2023 — cited in Chapter 4: Governance
  29. Anderljung, 2023 — cited in Chapter 4: Governance
  30. Anderljung, 2023 — cited in Chapter 4: Governance
  31. Anderljung, 2024 — cited in Chapter 4: Governance
  32. Andreas 2022 — cited in Chapter 7: Goal Misgeneralization
  33. Andriushchenko et al., 2024 — cited in Chapter 5: Evaluations
  34. Andy Zou et al., 2024 — cited in Chapter 3: Strategies
  35. Anna Desmarais, 2024 — cited in Chapter 3: Strategies
  36. Anthropic, 2023 — cited in Chapter 1: Capabilities
  37. Anthropic, 2023 — cited in Chapter 5: Evaluations
  38. Anthropic, 2023 — cited in Chapter 5: Evaluations
  39. Anthropic, 2023 — cited in Chapter 6: Specification Gaming
  40. Anthropic, 2024 — cited in Chapter 1: Capabilities
  41. Anthropic, 2024 — cited in Chapter 1: Capabilities
  42. Anthropic, 2024 — cited in Chapter 5: Evaluations
  43. Anthropic, 2024 — cited in Chapter 5: Evaluations
  44. Anthropic, 2024 — cited in Chapter 5: Evaluations
  45. Anthropic, 2024 — cited in Chapter 5: Evaluations
  46. Anthropic, 2024 — cited in Chapter 5: Evaluations
  47. Anthropic, 2024 — cited in Chapter 5: Evaluations
  48. Anthropic, 2024 — cited in Chapter 5: Evaluations
  49. Anthropic, 2025 — cited in Chapter 1: Capabilities
  50. Anthropic, 2025 — cited in Chapter 1: Capabilities
  51. Anthropic, 2025 — cited in Chapter 1: Capabilities
  52. Anthropic, 2025 — cited in Chapter 3: Strategies, Chapter 7: Goal Misgeneralization
  53. Anthropic, 2025 — cited in Chapter 3: Strategies
  54. Anthropic, 2025 — cited in Chapter 5: Evaluations
  55. Anthropic, 2025 — cited in Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  56. Anthropic, 2025 — cited in Chapter 5: Evaluations
  57. AP News, 2017 — cited in Chapter 4: Governance
  58. Apollo Research, 2024 — cited in Chapter 5: Evaluations
  59. Apvrille & Nakov, 2025 — cited in Chapter 2: Risks
  60. ARC-AGI, 2024 — cited in Chapter 1: Capabilities
  61. ArtificialAnalysis, 2025 — cited in Chapter 1: Capabilities
  62. Aschenbrenner, 2024 — cited in Chapter 1: Capabilities, Chapter 2: Risks
  63. Aschenbrenner, 2024 — cited in Chapter 1: Capabilities
  64. Aschenbrenner, 2024 — cited in Chapter 2: Risks, Chapter 3: Strategies
  65. Askell et al., 2024 — cited in Chapter 2: Risks, Chapter 4: Governance
  66. Badie et al., 2011 — cited in Chapter 4: Governance
  67. Bai et al., 2022 — cited in Chapter 6: Specification Gaming
  68. Baker et al., 2020 — cited in Chapter 2: Risks
  69. Baker et al., 2025 — cited in Chapter 3: Strategies
  70. Bakhtin et al., 2022 — cited in Chapter 1: Capabilities
  71. Bansal et al., 2022 — cited in Chapter 2: Risks
  72. Barnes et al., 2020 — cited in Chapter 8: Scalable Oversight
  73. Barnes et al., 2020 — cited in Chapter 8: Scalable Oversight
  74. Barnes, 2023 — cited in Chapter 7: Goal Misgeneralization
  75. Barnett & Thiergart, 2024 — cited in Chapter 4: Governance
  76. Barnett, 2025 — cited in Chapter 2: Risks
  77. Barnett, 2025 — cited in Chapter 2: Risks
  78. Barnett, 2025 — cited in Chapter 4: Governance
  79. Barros, 2025 — cited in Chapter 2: Risks
  80. Baumann, 2017 — cited in Chapter 2: Risks
  81. BBC, 2023 — cited in Chapter 6: Specification Gaming
  82. Belfield & Hua 2022 — cited in Chapter 4: Governance
  83. Bengio et al., 2023 — cited in Chapter 1: Capabilities
  84. Bengio et al., 2025 — cited in Chapter 4: Governance
  85. Bengio et al., 2025 — cited in Chapter 4: Governance
  86. Bengio, 2023 — cited in Chapter 3: Strategies
  87. Beraja et al., 2023, AI-tocracy — cited in Chapter 2: Risks
  88. Beren, 2023 — cited in Chapter 7: Goal Misgeneralization
  89. Berglund et al., 2024 — cited in Chapter 5: Evaluations
  90. Bernardi, 2024 — cited in Chapter 3: Strategies
  91. Besiroglu et al., 2024 — cited in Chapter 4: Governance
  92. Besiroglu et al., 2024 — cited in Chapter 5: Evaluations
  93. Besta et al., 2023 — cited in Chapter 5: Evaluations
  94. Betker et al., 2023 — cited in Chapter 1: Capabilities
  95. Betley et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  96. Bhatt et al., 2023 — cited in Chapter 5: Evaluations
  97. Bhatt et al., 2024 — cited in Chapter 5: Evaluations
  98. Bhatt et al., 2024 — cited in Chapter 5: Evaluations
  99. Binder et al., 2024 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  100. Blablová, 2025 — cited in Chapter 1: Capabilities
  101. Black et al., 2025 — cited in Chapter 2: Risks
  102. Bode & Watts, 2023 — cited in Chapter 2: Risks
  103. Bogdan et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  104. Boiko et al., 2023 — cited in Chapter 4: Governance
  105. Bommasani et al., 2022 — cited in Chapter 1: Capabilities
  106. Bondarenko et al., 2025 — cited in Chapter 2: Risks, Chapter 3: Strategies
  107. Boston Dynamics, 2024 — cited in Chapter 1: Capabilities
  108. Boston Dynamics, 2024 — cited in Chapter 1: Capabilities
  109. Bostrom, 2002 — cited in Chapter 2: Risks
  110. Bostrom, 2012 — cited in Chapter 2: Risks
  111. Bostrom, 2014 — cited in Chapter 1: Capabilities
  112. Bostrom, 2014 — cited in Chapter 6: Specification Gaming
  113. Bostrom, 2014 — cited in Chapter 7: Goal Misgeneralization
  114. Bowman et al., 2022 — cited in Chapter 8: Scalable Oversight
  115. Bowman, 2023 — cited in Chapter 1: Capabilities
  116. Bowman, 2024 — cited in Chapter 3: Strategies
  117. Bowman, 2024 — cited in Chapter 8: Scalable Oversight
  118. Bowman, 2025 — cited in Chapter 3: Strategies
  119. Bradford, 2020 — cited in Chapter 4: Governance
  120. Brass & Aarne, 2024 — cited in Chapter 4: Governance
  121. Brennan et al., 2025 — cited in Chapter 4: Governance
  122. Brown et al., 2020 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  123. Brown, 2024 — cited in Chapter 5: Evaluations
  124. Brundage et al., 2018 — cited in Chapter 4: Governance
  125. Brundage et al., 2018 — cited in Chapter 4: Governance
  126. Brundage, 2025 — cited in Chapter 3: Strategies
  127. Brunskill, 2022 — cited in Chapter 6: Specification Gaming
  128. Bubeck et al., 2023 — cited in Chapter 1: Capabilities
  129. Buchanan, 2020 — cited in Chapter 4: Governance
  130. Buhl et al., 2024 — cited in Chapter 4: Governance
  131. Burden, 2024 — cited in Chapter 5: Evaluations
  132. Burns et. al. 2023 — cited in Chapter 8: Scalable Oversight
  133. Buterin, 2023 — cited in Chapter 3: Strategies
  134. Buterin, 2025 — cited in Chapter 3: Strategies
  135. Caballero et al., 2023 — cited in Chapter 1: Capabilities
  136. CAIS, 2023 — cited in Chapter 2: Risks
  137. Campos et al., 2024 — cited in Chapter 3: Strategies
  138. Canell, 2015 — cited in Chapter 1: Capabilities
  139. Canell, 2022 — cited in Chapter 1: Capabilities
  140. Canell, 2022 — cited in Chapter 1: Capabilities
  141. Cao et al., 2023 — cited in Chapter 3: Strategies
  142. Cao et al., 2024 — cited in Chapter 6: Specification Gaming
  143. Carlini et al., 2021 — cited in Chapter 2: Risks, Chapter 6: Specification Gaming
  144. Carlsmith, 2020 — cited in Chapter 1: Capabilities
  145. Carlsmith, 2021 — cited in Chapter 2: Risks
  146. Carlsmith, 2023 — cited in Chapter 2: Risks, Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  147. Carlson, 2009 — cited in Chapter 2: Risks
  148. Carter et al., 2023 — cited in Chapter 2: Risks
  149. Carvalho et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  150. Casper et al., 2023 — cited in Chapter 3: Strategies
  151. Casper et al., 2023 — cited in Chapter 3: Strategies, Chapter 4: Governance
  152. Casper et al., 2024 — cited in Chapter 5: Evaluations
  153. Casper, 2023 — cited in Chapter 3: Strategies
  154. Casper, 2024 — cited in Chapter 4: Governance
  155. catubc, 2024 — cited in Chapter 3: Strategies
  156. Caucheteux & King, 2022 — cited in Chapter 1: Capabilities
  157. Cave & Ó hÉigeartaigh, 2018 — cited in Chapter 2: Risks
  158. Cerutti et al., 2025 — cited in Chapter 4: Governance
  159. Ceruzzi, 1989 — cited in Chapter 2: Risks
  160. CFG, 2025 — cited in Chapter 3: Strategies
  161. Cha, 2024 — cited in Chapter 4: Governance
  162. Chan et al., 2024 — cited in Chapter 4: Governance
  163. Chan et al., 2024 — cited in Chapter 4: Governance
  164. Chandra et al., 2024 — cited in Chapter 2: Risks
  165. Charvet, 2021 — cited in Chapter 1: Capabilities
  166. Cheerla, 2018 — cited in Chapter 2: Risks
  167. Chehoudi, 2025 — cited in Chapter 4: Governance
  168. Chen et al, 2021 — cited in Chapter 5: Evaluations
  169. Chen et al., 2017 — cited in Chapter 2: Risks
  170. Chen et al., 2022 — cited in Chapter 2: Risks
  171. Chen et al., 2024 — cited in Chapter 2: Risks
  172. Chen et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  173. Chen et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  174. Cheng & McKernon, 2024 — cited in Chapter 4: Governance
  175. Cheng, 2024 — cited in Chapter 4: Governance
  176. Cheng, 2024 — cited in Chapter 4: Governance
  177. Cherny, 2025, Twitter — cited in Chapter 1: Capabilities
  178. Chess.com, 2014 — cited in Chapter 2: Risks
  179. Chollet et al., 2024 — cited in Chapter 5: Evaluations
  180. Chollet et. al, 2024 — cited in Chapter 1: Capabilities, Chapter 2: Risks
  181. Chollet, 2019 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  182. Chollet, 2023 — cited in Chapter 1: Capabilities
  183. Chollet, 2024 — cited in Chapter 5: Evaluations
  184. Chollet, 2025 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  185. Christiano et al., 2017 — cited in Chapter 6: Specification Gaming
  186. Christiano Paul, 2016 — cited in Chapter 8: Scalable Oversight
  187. Christiano, 2016 — cited in Chapter 8: Scalable Oversight
  188. Christiano, 2016 — cited in Chapter 8: Scalable Oversight
  189. Christiano, 2017 — cited in Chapter 3: Strategies
  190. Christiano, 2018 — cited in Chapter 1: Capabilities
  191. Christiano, 2018 — cited in Chapter 3: Strategies
  192. Christiano, 2018 — cited in Chapter 3: Strategies
  193. Christiano, 2019 — cited in Chapter 2: Risks
  194. Christiano, 2019 — cited in Chapter 5: Evaluations
  195. Christiano, 2019 — cited in Chapter 6: Specification Gaming
  196. Christiano, 2020 — cited in Chapter 8: Scalable Oversight
  197. Christiano, 2022 — cited in Chapter 3: Strategies
  198. Christiano, 2023 — cited in Chapter 2: Risks
  199. Christiano, 2023 — cited in Chapter 3: Strategies
  200. Christiano, 2023 — cited in Chapter 3: Strategies
  201. Cihon et al., 2020 — cited in Chapter 3: Strategies
  202. Cihon et al., 2021 — cited in Chapter 4: Governance
  203. Cihon, 2019 — cited in Chapter 4: Governance
  204. Cihon, 2019 — cited in Chapter 4: Governance
  205. Cima et al, 2010 — cited in Chapter 3: Strategies
  206. CISA, 2021 — cited in Chapter 2: Risks
  207. CISA, 2024 — cited in Chapter 2: Risks
  208. Clark & Amodei,2016 — cited in Chapter 2: Risks, Chapter 6: Specification Gaming
  209. Clymer et al, 2024 — cited in Chapter 3: Strategies
  210. Clymer et al., 2024 — cited in Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  211. Clymer, 2025 — cited in Chapter 3: Strategies
  212. Cobbe et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  213. Cobbe et al., 2021 — cited in Chapter 5: Evaluations
  214. Conn, 2015 — cited in Chapter 2: Risks
  215. Control AI, 2024 — cited in Chapter 3: Strategies
  216. Corwin, 2002 — cited in Chapter 3: Strategies
  217. Cotra, 2020 — cited in Chapter 1: Capabilities
  218. Cotra, 2021 — cited in Chapter 7: Goal Misgeneralization
  219. Cotra, 2021 — cited in Chapter 8: Scalable Oversight
  220. Cotra, 2022 — cited in Chapter 4: Governance
  221. Cotra, 2023 — cited in Chapter 1: Capabilities, Chapter 2: Risks
  222. Cotra, 2023 — cited in Chapter 1: Capabilities
  223. Cotra, 2023 — cited in Chapter 2: Risks, Chapter 4: Governance
  224. Cottier et al., 2025 — cited in Chapter 1: Capabilities
  225. Creswell et al., 2022 — cited in Chapter 1: Capabilities
  226. Critch and Russel, 2023 — cited in Chapter 2: Risks, Chapter 3: Strategies
  227. Critch, 2021 — cited in Chapter 2: Risks, Chapter 3: Strategies, Chapter 7: Goal Misgeneralization
  228. Critch, 2022 — cited in Chapter 3: Strategies
  229. Critch, 2023 — cited in Chapter 5: Evaluations
  230. CrowdStrike, 2024 — cited in Chapter 2: Risks
  231. Cumulative number of large-scale AI models by domain since 2017 — cited in Chapter 1: Capabilities
  232. Cumulative number of large-scale AI systems by country since 2019 — cited in Chapter 4: Governance
  233. Cunha & Estima, 2023 — cited in Chapter 2: Risks
  234. Cunningham et al., 2023 — cited in Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  235. Dafoe, 2018 — cited in Chapter 4: Governance
  236. Dafoe, 2020 — cited in Chapter 4: Governance
  237. Dafoe, 2022 — cited in Chapter 4: Governance
  238. Dafoe, 2023 — cited in Chapter 4: Governance
  239. Dafoe, 2023 — cited in Chapter 4: Governance
  240. Dai, 2019 — cited in Chapter 2: Risks
  241. Dalrymple, 2022 — cited in Chapter 3: Strategies
  242. Davidson et al, 2025 — cited in Chapter 3: Strategies
  243. Davidson et al., 2023 — cited in Chapter 4: Governance, Chapter 5: Evaluations
  244. Davidson, 2023 — cited in Chapter 1: Capabilities
  245. Davidson, 2024 — cited in Chapter 1: Capabilities
  246. Davidson, 2025 — cited in Chapter 3: Strategies
  247. Davidson, 2025 — cited in Chapter 3: Strategies
  248. DavidW, 2023 — cited in Chapter 7: Goal Misgeneralization
  249. de Haan et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  250. Dean, 2025 — cited in Chapter 3: Strategies
  251. DeepMind, 2016 — cited in Chapter 1: Capabilities, Chapter 6: Specification Gaming
  252. DeepMind, 2018 — cited in Chapter 6: Specification Gaming
  253. DeepMind, 2018 — cited in Chapter 6: Specification Gaming
  254. DeepMind, 2019 — cited in Chapter 6: Specification Gaming
  255. DeepMind, 2020 — cited in Chapter 1: Capabilities
  256. DeepMind, 2022 — cited in Chapter 1: Capabilities
  257. DeepMind, 2022 — cited in Chapter 7: Goal Misgeneralization
  258. DeepMind, 2023 — cited in Chapter 1: Capabilities
  259. DeepMind, 2024 — cited in Chapter 1: Capabilities
  260. DeepMind, 2024 — cited in Chapter 2: Risks
  261. DeepMind, 2024 — cited in Chapter 4: Governance
  262. DeepMind, 2025 — cited in Chapter 1: Capabilities
  263. DeepMind, 2025 — cited in Chapter 2: Risks
  264. DeepSeek, 2025 — cited in Chapter 3: Strategies, Chapter 4: Governance
  265. DeepSeek, 2025 — cited in Chapter 5: Evaluations
  266. Defense Innovation Unit, 2023 — cited in Chapter 2: Risks
  267. Delétang et al., 2023 — cited in Chapter 1: Capabilities
  268. Deng, 2009 — cited in Chapter 5: Evaluations
  269. Dev & Hobbhahn, 2024 — cited in Chapter 5: Evaluations
  270. Dewey, 2011 — cited in Chapter 3: Strategies
  271. DiGiovanni, 2023 — cited in Chapter 2: Risks
  272. Ding & Dafoe, 2024 — cited in Chapter 4: Governance
  273. Ding, 2018 — cited in Chapter 4: Governance
  274. DnaScript, 2024 — cited in Chapter 2: Risks
  275. Dong et al., 2024 — cited in Chapter 4: Governance
  276. Douillard et al, 2023 — cited in Chapter 3: Strategies
  277. Douillard et al, 2024 — cited in Chapter 3: Strategies
  278. Douillard et al., 2024 — cited in Chapter 3: Strategies, Chapter 4: Governance
  279. Dowie, 1977 — cited in Chapter 2: Risks
  280. Dragan et al., 2024 — cited in Chapter 5: Evaluations
  281. Edelman & Ho, 2025 — cited in Chapter 1: Capabilities
  282. Egan & Heim, 2023 — cited in Chapter 3: Strategies, Chapter 4: Governance
  283. Egan & Heim, 2023 — cited in Chapter 4: Governance
  284. Eiras et al., 2024 — cited in Chapter 3: Strategies, Chapter 4: Governance
  285. El-Mhamdi et al., 2023 — cited in Chapter 3: Strategies
  286. Electricity generation by country and region in 2025 — cited in Chapter 1: Capabilities
  287. Elmore, 2024 — cited in Chapter 1: Capabilities
  288. Encyclopedia Britannica, 2025 — cited in Chapter 3: Strategies
  289. Epicural, 2021 — cited in Chapter 6: Specification Gaming
  290. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  291. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  292. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  293. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  294. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  295. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  296. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  297. Epoch AI, 2025 — cited in Chapter 1: Capabilities
  298. EpochAI, 2025 — cited in Chapter 1: Capabilities
  299. EpochAI, 2025 — cited in Chapter 1: Capabilities
  300. EpochAI, 2025 — cited in Chapter 1: Capabilities
  301. EpochAI, 2025 — cited in Chapter 3: Strategies
  302. EpochAI, 2026 — cited in Chapter 1: Capabilities, Chapter 2: Risks, Chapter 5: Evaluations
  303. Erdil & Besiroglu, 2024 — cited in Chapter 1: Capabilities
  304. Erdil and Barnett, 2025 — cited in Chapter 2: Risks
  305. Erdil et al., 2025 — cited in Chapter 1: Capabilities
  306. Esvelt, 2022 — cited in Chapter 2: Risks
  307. Ethayarajh et al., 2022 — cited in Chapter 6: Specification Gaming
  308. Etienne & Flammarion, 2025 — cited in Chapter 7: Goal Misgeneralization
  309. EU Commission, 2025 — cited in Chapter 1: Capabilities
  310. European Commission, 2024 — cited in Chapter 5: Evaluations
  311. Evans et al., 2023 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  312. Evans, 2024 — cited in Chapter 5: Evaluations
  313. Everitt et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  314. Ewing, 2017 — cited in Chapter 5: Evaluations
  315. Exfilbench, 2025 — cited in Chapter 3: Strategies
  316. Eykholt et al., 2018 — cited in Chapter 2: Risks
  317. Faggella, 2025 — cited in Chapter 3: Strategies
  318. Fang et al., 2024 — cited in Chapter 2: Risks, Chapter 4: Governance
  319. Farrell, 2024 — cited in Chapter 4: Governance
  320. Federspiel et al., 2023 — cited in Chapter 2: Risks
  321. Feldstein, 2019 — cited in Chapter 2: Risks
  322. Feldstein, 2021 — cited in Chapter 2: Risks
  323. Feng & Florian Tramèr, 2024 — cited in Chapter 2: Risks
  324. Fenwick, 2023 — cited in Chapter 3: Strategies
  325. Feuillade-Montixi & Peigné, 2023 — cited in Chapter 1: Capabilities
  326. Field, 2025 — cited in Chapter 2: Risks
  327. FLI, 2025 — cited in Chapter 2: Risks, Chapter 3: Strategies
  328. Flint, 2022 — cited in Chapter 3: Strategies
  329. Fluri et al., 2023 — cited in Chapter 1: Capabilities
  330. Forethought, 2025 — cited in Chapter 3: Strategies
  331. Friedman et al., 2007 — cited in Chapter 4: Governance
  332. Friston et al., 2022 — cited in Chapter 2: Risks
  333. Fu et al., 2024 — cited in Chapter 1: Capabilities
  334. Future of Life Institute, 2024 — cited in Chapter 2: Risks
  335. Future of Life Institute, 2024 — cited in Chapter 2: Risks
  336. Gabriel et al., 2024 — cited in Chapter 2: Risks
  337. Ganguli et al., 2022 — cited in Chapter 4: Governance
  338. Gao, 2022 — cited in Chapter 6: Specification Gaming
  339. Geirhos et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  340. Gennari et al., 2024 — cited in Chapter 5: Evaluations
  341. Giattino et al., 2023 — cited in Chapter 1: Capabilities
  342. Giattino et al., 2023 — cited in Chapter 1: Capabilities, Chapter 2: Risks, Chapter 4: Governance, Chapter 5: Evaluations
  343. Giattino et al., 2023 — cited in Chapter 4: Governance
  344. Gil, 2023 — cited in Chapter 3: Strategies
  345. Glaese et al, 2022 — cited in Chapter 6: Specification Gaming
  346. Glazer et al., 2024 — cited in Chapter 5: Evaluations
  347. Gleave, 2025 — cited in Chapter 3: Strategies
  348. Gnanasambandam et al, 2021 — cited in Chapter 2: Risks
  349. Goemans et al., 2024 — cited in Chapter 3: Strategies
  350. Goertzel & Pitt, 2012 — cited in Chapter 3: Strategies
  351. Goertzel et. al., 2023 — cited in Chapter 1: Capabilities
  352. Goertzel, 2010 — cited in Chapter 3: Strategies
  353. Goldie et al., 2024 — cited in Chapter 2: Risks
  354. Goldowsky-Dill et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  355. Goldwasser et al., 2024 — cited in Chapter 2: Risks
  356. Golovneva et al., 2024 — cited in Chapter 5: Evaluations
  357. Goodfellow et al., 2014 — cited in Chapter 1: Capabilities
  358. Goodfellow et al., 2014 — cited in Chapter 2: Risks
  359. Goodhart, 1975 — cited in Chapter 2: Risks
  360. Google DeepMind, 2019 — cited in Chapter 1: Capabilities
  361. Google DeepMind, 2020 — cited in Chapter 1: Capabilities, Chapter 6: Specification Gaming
  362. Google DeepMind, 2022 — cited in Chapter 1: Capabilities
  363. Google DeepMind, 2024 — cited in Chapter 1: Capabilities
  364. Google DeepMind, 2024 — cited in Chapter 1: Capabilities
  365. Google DeepMind, 2024 — cited in Chapter 1: Capabilities
  366. Google DeepMind, 2025 — cited in Chapter 1: Capabilities
  367. Google DeepMind, 2025 — cited in Chapter 1: Capabilities
  368. Google DeepMind, 2025 — cited in Chapter 1: Capabilities
  369. Google DeepMind, 2025 — cited in Chapter 1: Capabilities
  370. Google DeepMind, 2025 — cited in Chapter 1: Capabilities
  371. Google DeepMind, 2025 — cited in Chapter 1: Capabilities
  372. Google, 2023 — cited in Chapter 1: Capabilities
  373. Google, 2025 — cited in Chapter 1: Capabilities
  374. Google, 2025 — cited in Chapter 1: Capabilities
  375. Grace et al., 2017 — cited in Chapter 4: Governance
  376. Grace et al., 2024 — cited in Chapter 4: Governance
  377. Greenblatt & Roger, 2024 — cited in Chapter 5: Evaluations
  378. Greenblatt & Shlegeris, 2024 — cited in Chapter 3: Strategies
  379. Greenblatt & Shlegeris, 2024 — cited in Chapter 5: Evaluations
  380. Greenblatt & Shlegreis, 2024 — cited in Chapter 5: Evaluations
  381. Greenblatt et al., 2023 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  382. Greenblatt et al., 2023 — cited in Chapter 5: Evaluations
  383. Greenblatt et al., 2024 — cited in Chapter 2: Risks, Chapter 3: Strategies, Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  384. Greenblatt et al., 2024 — cited in Chapter 3: Strategies
  385. Greenblatt et al., 2024 — cited in Chapter 5: Evaluations
  386. Greenblatt et al., 2024 — cited in Chapter 5: Evaluations
  387. Greenblatt, 2025 — cited in Chapter 3: Strategies
  388. Greenblatt, 2025 — cited in Chapter 3: Strategies
  389. Greenblatt, 2025 — cited in Chapter 5: Evaluations
  390. Greenblatt, 2025 — cited in Chapter 5: Evaluations
  391. Greenwalt, 2023 — cited in Chapter 2: Risks
  392. Griffin et al., 2024 — cited in Chapter 5: Evaluations
  393. Gruetzemacher et al., 2021 — cited in Chapter 4: Governance
  394. Gruetzemacher et al., 2024 — cited in Chapter 2: Risks, Chapter 4: Governance
  395. Grunewald, 2023 — cited in Chapter 4: Governance
  396. Gurney & Tegmark, 2024 — cited in Chapter 1: Capabilities
  397. Gwern, 2016 — cited in Chapter 2: Risks
  398. Gwern, 2020 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  399. Habli et al., 2025 — cited in Chapter 3: Strategies
  400. Hadley et al., 2024 — cited in Chapter 4: Governance
  401. Hai et al, 2024 — cited in Chapter 3: Strategies
  402. Haldane and May, 2011 — cited in Chapter 2: Risks
  403. Hammond et al., 2025 — cited in Chapter 2: Risks, Chapter 3: Strategies
  404. Hanson, 2023 — cited in Chapter 3: Strategies
  405. Hao et al, 2024 — cited in Chapter 3: Strategies, Chapter 7: Goal Misgeneralization
  406. Harvard, 2025 — cited in Chapter 3: Strategies
  407. Haugen, 2021 — cited in Chapter 2: Risks
  408. Hausenloy et al., 2023 — cited in Chapter 4: Governance
  409. Hausenloy et al., 2024 — cited in Chapter 4: Governance
  410. Heelan, 2025 — cited in Chapter 2: Risks
  411. Heim & Koessler, 2024 — cited in Chapter 4: Governance
  412. Heim et al., 2024 — cited in Chapter 4: Governance
  413. Heim et al., 2024 — cited in Chapter 4: Governance
  414. Heim et al., 2024 — cited in Chapter 4: Governance
  415. Heim, 2021 — cited in Chapter 4: Governance
  416. Hendrycks & Wang, 2024 — cited in Chapter 5: Evaluations
  417. Hendrycks et al., 2020 — cited in Chapter 5: Evaluations, Chapter 8: Scalable Oversight
  418. Hendrycks et al., 2021 — cited in Chapter 5: Evaluations
  419. Hendrycks et al., 2021 — cited in Chapter 5: Evaluations
  420. Hendrycks et al., 2022 — cited in Chapter 1: Capabilities
  421. Hendrycks et al., 2022 — cited in Chapter 2: Risks, Chapter 3: Strategies, Chapter 4: Governance
  422. Hendrycks et al., 2023 — cited in Chapter 5: Evaluations
  423. Hendrycks et al., 2024 — cited in Chapter 4: Governance
  424. Hendrycks et al., 2025 — cited in Chapter 1: Capabilities
  425. Hendrycks et al., 2025 — cited in Chapter 3: Strategies
  426. Hendrycks et al., 2025 — cited in Chapter 3: Strategies
  427. Hendrycks, 2024 — cited in Chapter 2: Risks
  428. Hendrycks, 2024 — cited in Chapter 2: Risks
  429. Hendrycks, 2024 — cited in Chapter 4: Governance, Chapter 5: Evaluations
  430. Hendrycks, 2024 — cited in Chapter 6: Specification Gaming
  431. Hendrycks, 2025 — cited in Chapter 2: Risks
  432. Hendryks, 2024 — cited in Chapter 4: Governance
  433. Hernandez, 2025 — cited in Chapter 3: Strategies
  434. Herrera-Poyatos et al., 2025 — cited in Chapter 4: Governance
  435. Hill, 2024 — cited in Chapter 3: Strategies
  436. Hinton, 2024 — cited in Chapter 3: Strategies
  437. Ho & Berg, 2025 — cited in Chapter 2: Risks
  438. Ho et al., 2023 — cited in Chapter 1: Capabilities
  439. Ho et al., 2023 — cited in Chapter 4: Governance
  440. Ho et al., 2023 — cited in Chapter 4: Governance
  441. Ho et al., 2024 — cited in Chapter 1: Capabilities
  442. Ho et al., 2025 — cited in Chapter 1: Capabilities
  443. Ho, 2022 — cited in Chapter 1: Capabilities
  444. Ho, 2025 — cited in Chapter 5: Evaluations
  445. Hobbahn et al., 2023 — cited in Chapter 1: Capabilities
  446. Hobbahn, 2024 — cited in Chapter 5: Evaluations
  447. Hobbhahn et al., 2024 — cited in Chapter 3: Strategies
  448. Hoffmann et al., 2022 — cited in Chapter 1: Capabilities
  449. Hofstadter, 2023 — cited in Chapter 2: Risks
  450. Hooker, 2024 — cited in Chapter 4: Governance
  451. Houzel, 2012 — cited in Chapter 1: Capabilities
  452. Hsu et al., 2023 — cited in Chapter 4: Governance
  453. Huang et al., 2022 — cited in Chapter 3: Strategies
  454. Hubinger et al., 2019 — cited in Chapter 5: Evaluations, Chapter 6: Specification Gaming, Chapter 7: Goal Misgeneralization
  455. Hubinger et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  456. Hubinger et al., 2023 — cited in Chapter 5: Evaluations
  457. Hubinger et al., 2024 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  458. Hubinger Evan, 2020 — cited in Chapter 8: Scalable Oversight
  459. Hubinger, 2020 — cited in Chapter 1: Capabilities
  460. Hubinger, 2022 — cited in Chapter 7: Goal Misgeneralization
  461. Hubinger, 2023 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  462. Hubinger, 2023 — cited in Chapter 5: Evaluations
  463. Human Rights Watch, 2024 — cited in Chapter 2: Risks
  464. Hung, 2025 — cited in Chapter 4: Governance
  465. HYAS, 2023 — cited in Chapter 2: Risks
  466. IBM, 2023 — cited in Chapter 1: Capabilities
  467. IBM, 2026 — cited in Chapter 1: Capabilities
  468. IBM, 2026 — cited in Chapter 1: Capabilities
  469. Inan et al., 2021 — cited in Chapter 6: Specification Gaming
  470. Intel, 2024 — cited in Chapter 4: Governance
  471. Ionut-Cirstea, 2023 — cited in Chapter 3: Strategies
  472. Irving & Askell, 2019 — cited in Chapter 4: Governance
  473. Irving et al., 2017 — cited in Chapter 8: Scalable Oversight
  474. Jaghouar et al., 2024 — cited in Chapter 4: Governance
  475. Jagielski, 2024 — cited in Chapter 4: Governance
  476. Janssen et al., 2025 — cited in Chapter 4: Governance
  477. Janus, 2022 — cited in Chapter 7: Goal Misgeneralization
  478. Ji et al., 2024 — cited in Chapter 6: Specification Gaming
  479. Jiang et al., 2019 — cited in Chapter 2: Risks
  480. Jonker et al., 2024 — cited in Chapter 3: Strategies
  481. Jumper et al., 2021 — cited in Chapter 1: Capabilities
  482. Juneja et al., 2023 — cited in Chapter 7: Goal Misgeneralization
  483. Kadavath, 2022 — cited in Chapter 1: Capabilities
  484. Kaplan et al., 2020 — cited in Chapter 1: Capabilities
  485. Kapoor et al., 2024 — cited in Chapter 3: Strategies
  486. Karimi, 2023 — cited in Chapter 2: Risks
  487. Karnofsky, 2016 — cited in Chapter 1: Capabilities
  488. Karnofsky, 2022 — cited in Chapter 2: Risks
  489. Karnofsky, 2024 — cited in Chapter 4: Governance
  490. Kasirzadeh, 2024 — cited in Chapter 2: Risks
  491. Keefe, 2017 — cited in Chapter 2: Risks
  492. Kees-Dupuis & Janus, 2023 — cited in Chapter 3: Strategies
  493. Kenton et al., 2024 — cited in Chapter 8: Scalable Oversight
  494. Keskar et al.; 2017 — cited in Chapter 7: Goal Misgeneralization
  495. Khan et al., 2022 — cited in Chapter 3: Strategies
  496. Khan et al., 2024 — cited in Chapter 8: Scalable Oversight
  497. King & Meinhardt, 2024 — cited in Chapter 2: Risks
  498. Kinniment et al., 2024 — cited in Chapter 3: Strategies
  499. Kinniment, 2025 — cited in Chapter 7: Goal Misgeneralization
  500. Kirilenko et al., 2017 — cited in Chapter 2: Risks
  501. Kirillov et al., 2023 — cited in Chapter 1: Capabilities
  502. Kleinberg & Raghavan, 2021 — cited in Chapter 3: Strategies
  503. Koessler & Schuett, 2023 — cited in Chapter 4: Governance
  504. Kokotajlo et al., 2025 — cited in Chapter 2: Risks, Chapter 3: Strategies, Chapter 4: Governance
  505. Kokotajlo, 2021 — cited in Chapter 2: Risks
  506. Kolt et al., 2024 — cited in Chapter 4: Governance
  507. Korbak et al., 2023 — cited in Chapter 6: Specification Gaming
  508. Korbak et al., 2025 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  509. Korbak et al., 2025 — cited in Chapter 3: Strategies
  510. Korbak et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  511. Korzekwa, 2022 — cited in Chapter 1: Capabilities
  512. Kosinski 2023 — cited in Chapter 1: Capabilities
  513. Kosoy, 2023 — cited in Chapter 3: Strategies
  514. Kovařík et al., 2019 — cited in Chapter 8: Scalable Oversight
  515. Krakovna et al., 2020 — cited in Chapter 1: Capabilities, Chapter 2: Risks
  516. Krakovna et al., 2020 — cited in Chapter 6: Specification Gaming
  517. Kreps & Kriner, 2023 — cited in Chapter 4: Governance
  518. Krizhevsky, 2009 — cited in Chapter 5: Evaluations
  519. Krueger et al., 2020 — cited in Chapter 7: Goal Misgeneralization
  520. Kulveit, 2025 — cited in Chapter 3: Strategies
  521. Kumar, 2022 — cited in Chapter 7: Goal Misgeneralization
  522. Kwa et al., 2025 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  523. LaCroix & Luccioni, 2022 — cited in Chapter 3: Strategies
  524. Ladish & Heim, 2022 — cited in Chapter 3: Strategies
  525. Ladish, 2023 — cited in Chapter 3: Strategies
  526. Laine et al., 2024 — cited in Chapter 2: Risks, Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  527. Lam et al., 2023 — cited in Chapter 3: Strategies
  528. Lancieri et al., 2024 — cited in Chapter 4: Governance
  529. Langosco et al., 2022 — cited in Chapter 7: Goal Misgeneralization
  530. Lanham et al., 2023 — cited in Chapter 3: Strategies, Chapter 8: Scalable Oversight
  531. Lanham, 2022 — cited in Chapter 3: Strategies, Chapter 8: Scalable Oversight
  532. Lazar, 2024 — cited in Chapter 4: Governance
  533. Leahy & Alfour, 2023 — cited in Chapter 3: Strategies
  534. Leahy et al., 2024 — cited in Chapter 2: Risks
  535. Leake, 2023 — cited in Chapter 3: Strategies
  536. LeCun, 1998 — cited in Chapter 5: Evaluations
  537. LeCun, 2022 — cited in Chapter 1: Capabilities
  538. LeCun, 2025 — cited in Chapter 1: Capabilities
  539. Legg & Hutter, 2007 — cited in Chapter 1: Capabilities
  540. Lehalleur et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  541. Leike, 2022 — cited in Chapter 3: Strategies, Chapter 8: Scalable Oversight
  542. Leike, 2023 — cited in Chapter 3: Strategies
  543. Leike, 2023 — cited in Chapter 8: Scalable Oversight
  544. Lermen et al., 2024 — cited in Chapter 3: Strategies
  545. Li et al., 2017 — cited in Chapter 7: Goal Misgeneralization
  546. Li et al., 2022 — cited in Chapter 2: Risks
  547. Li et al., 2023 — cited in Chapter 6: Specification Gaming
  548. Li et al., 2024 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  549. Li, 2025 — cited in Chapter 4: Governance
  550. Liang et al., 2022 — cited in Chapter 3: Strategies
  551. Lightman et al., 2023 — cited in Chapter 1: Capabilities, Chapter 3: Strategies, Chapter 8: Scalable Oversight
  552. Lin et al., 2022 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  553. Liu et al., 2023 — cited in Chapter 2: Risks
  554. Liu et al., 2024 — cited in Chapter 2: Risks
  555. Liu, 2023 — cited in Chapter 5: Evaluations
  556. Liu, 2024 — cited in Chapter 3: Strategies
  557. Lizka, 2023 — cited in Chapter 3: Strategies
  558. Longpre et al., 2023 — cited in Chapter 2: Risks, Chapter 4: Governance
  559. Longpre et al., 2024 — cited in Chapter 4: Governance
  560. Lu et al., 2024 — cited in Chapter 7: Goal Misgeneralization
  561. Luo et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  562. Maas & Villalobos, 2024 — cited in Chapter 4: Governance
  563. Maas, 2019 — cited in Chapter 4: Governance
  564. MacAskill at al, 2025 — cited in Chapter 3: Strategies
  565. MacDermott et al., 2024 — cited in Chapter 7: Goal Misgeneralization
  566. MacDiarmid et al., 2024 — cited in Chapter 7: Goal Misgeneralization
  567. Manheim & Garrabrant, 2018 — cited in Chapter 2: Risks
  568. Mannheim, 2023 — cited in Chapter 3: Strategies
  569. Marchal et al., 2024 — cited in Chapter 4: Governance
  570. Marcucci et al., 2023 — cited in Chapter 4: Governance
  571. Marcus, 2025 — cited in Chapter 1: Capabilities
  572. Marks et al., 2023 — cited in Chapter 5: Evaluations
  573. Martin & Eth, 2021 — cited in Chapter 1: Capabilities
  574. Masi, 2024 — cited in Chapter 4: Governance
  575. Maynez et al., 2020 — cited in Chapter 1: Capabilities
  576. Mazeika et al., 2024 — cited in Chapter 5: Evaluations
  577. McAleese et al., 2024 — cited in Chapter 8: Scalable Oversight
  578. McCoy et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  579. McGrath et al., 2021 — cited in Chapter 1: Capabilities
  580. McGregor, 2020 — cited in Chapter 2: Risks
  581. McKernon et al., 2024 — cited in Chapter 4: Governance
  582. McKernon et al., 2024 — cited in Chapter 4: Governance
  583. Meinke et al., 2024 — cited in Chapter 3: Strategies, Chapter 5: Evaluations, Chapter 7: Goal Misgeneralization
  584. Meng et al., 2023 — cited in Chapter 1: Capabilities
  585. Merchant et al., 2023 — cited in Chapter 3: Strategies
  586. META, 2022 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  587. Meta, 2022 — cited in Chapter 5: Evaluations
  588. Metaculus, 2025 — cited in Chapter 2: Risks
  589. Metaculus, 2025 — cited in Chapter 2: Risks
  590. METR, 2023 — cited in Chapter 2: Risks
  591. METR, 2023 — cited in Chapter 2: Risks
  592. METR, 2023 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  593. METR, 2023 — cited in Chapter 5: Evaluations
  594. METR, 2024 — cited in Chapter 2: Risks
  595. METR, 2024 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  596. METR, 2024 — cited in Chapter 5: Evaluations
  597. METR, 2025 — cited in Chapter 2: Risks
  598. METR, 2025 — cited in Chapter 3: Strategies
  599. METR, 2025 — cited in Chapter 4: Governance
  600. Michael et al., 2023 — cited in Chapter 8: Scalable Oversight
  601. Mikulik, 2019 — cited in Chapter 7: Goal Misgeneralization
  602. Miller, 2022 — cited in Chapter 3: Strategies
  603. Millidge, 2023 — cited in Chapter 5: Evaluations
  604. Millidge, 2025 — cited in Chapter 3: Strategies
  605. Mingard et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  606. Miotti et al, 2024 — cited in Chapter 3: Strategies
  607. Mirhoseini et al., 2020 — cited in Chapter 2: Risks
  608. Mishra, 2024 — cited in Chapter 4: Governance
  609. Mnih et al., 2013 — cited in Chapter 1: Capabilities
  610. Morris et al., 2024 — cited in Chapter 1: Capabilities
  611. Moskvichev et al. 2023 — cited in Chapter 5: Evaluations
  612. Mouton et al., 2023 — cited in Chapter 2: Risks, Chapter 4: Governance
  613. Mowshowitz, 2023 — cited in Chapter 3: Strategies
  614. Mowshowitz, 2023 — cited in Chapter 3: Strategies
  615. Mowshowitz, 2025 — cited in Chapter 3: Strategies
  616. Mowshowitz, 2025 — cited in Chapter 3: Strategies
  617. Muehlhauser, 2012 — cited in Chapter 1: Capabilities
  618. Mukobi, 2024 — cited in Chapter 4: Governance
  619. Mukobi, 2024 — cited in Chapter 5: Evaluations
  620. Munk Debate, 2024 — cited in Chapter 2: Risks
  621. Murphy, 2013 — cited in Chapter 2: Risks
  622. Nakano et al, 2021 — cited in Chapter 5: Evaluations
  623. Nanda et al., 2023 — cited in Chapter 1: Capabilities
  624. Nanda, 2025 — cited in Chapter 5: Evaluations
  625. Narayan & Kapoor, 2024 — cited in Chapter 4: Governance
  626. Narayanan & Kapoor, 2024 — cited in Chapter 4: Governance
  627. Nardo, 2023 — cited in Chapter 6: Specification Gaming, Chapter 7: Goal Misgeneralization
  628. NASA, 2004 — cited in Chapter 2: Risks
  629. Nasr et al., 2023 — cited in Chapter 2: Risks
  630. Neuralt, 2024 — cited in Chapter 3: Strategies
  631. Nevo et al., 2024 — cited in Chapter 3: Strategies, Chapter 4: Governance
  632. Nevo et al., 2024 — cited in Chapter 4: Governance
  633. Newman, 2024 — cited in Chapter 2: Risks
  634. Ng, 2025 — cited in Chapter 3: Strategies
  635. Ngo, 2023 — cited in Chapter 1: Capabilities
  636. Ngo, 2024 — cited in Chapter 3: Strategies
  637. Nguyen et al., 2023 — cited in Chapter 2: Risks
  638. NIST, 2023 — cited in Chapter 3: Strategies
  639. Novikov et al., 2025 — cited in Chapter 2: Risks
  640. NSCEB, 2024 — cited in Chapter 2: Risks
  641. NVIDIA, 2025 — cited in Chapter 4: Governance
  642. O'Brien et al., 2023 — cited in Chapter 4: Governance
  643. OECD, 2025 — cited in Chapter 1: Capabilities
  644. OECD, 2025 — cited in Chapter 4: Governance
  645. Office of the Attorney General, 2023 — cited in Chapter 2: Risks
  646. Olah, 2023 — cited in Chapter 5: Evaluations
  647. Olds & Milner, 1954 — cited in Chapter 2: Risks
  648. Olds, 1956 — cited in Chapter 2: Risks
  649. Omohundro, 2008 — cited in Chapter 6: Specification Gaming
  650. OpenAI, 2017 — cited in Chapter 2: Risks
  651. OpenAI, 2017 — cited in Chapter 6: Specification Gaming
  652. OpenAI, 2018 — cited in Chapter 6: Specification Gaming
  653. OpenAI, 2019 — cited in Chapter 1: Capabilities, Chapter 6: Specification Gaming
  654. OpenAI, 2022 — cited in Chapter 3: Strategies
  655. OpenAI, 2022 — cited in Chapter 3: Strategies
  656. OpenAI, 2022 — cited in Chapter 6: Specification Gaming
  657. OpenAI, 2022 — cited in Chapter 6: Specification Gaming
  658. OpenAI, 2023 — cited in Chapter 1: Capabilities
  659. OpenAI, 2023 — cited in Chapter 1: Capabilities
  660. OpenAI, 2023 — cited in Chapter 2: Risks, Chapter 3: Strategies, Chapter 5: Evaluations, Chapter 6: Specification Gaming
  661. OpenAI, 2023 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  662. OpenAI, 2023 — cited in Chapter 3: Strategies
  663. OpenAI, 2023 — cited in Chapter 5: Evaluations
  664. OpenAI, 2023 — cited in Chapter 6: Specification Gaming
  665. OpenAI, 2024 — cited in Chapter 1: Capabilities
  666. OpenAI, 2024 — cited in Chapter 3: Strategies
  667. OpenAI, 2024 — cited in Chapter 5: Evaluations
  668. OpenAI, 2024 — cited in Chapter 5: Evaluations
  669. OpenAI, 2024 — cited in Chapter 5: Evaluations
  670. OpenAI, 2025 — cited in Chapter 1: Capabilities
  671. OpenAI, 2025 — cited in Chapter 1: Capabilities
  672. OpenAI, 2025 — cited in Chapter 1: Capabilities
  673. OpenAI, 2025 — cited in Chapter 3: Strategies
  674. OpenAI, 2025 — cited in Chapter 4: Governance
  675. OpenAI, 2025 — cited in Chapter 5: Evaluations
  676. Ord, 2020 — cited in Chapter 2: Risks
  677. Ought, 2018 — cited in Chapter 8: Scalable Oversight
  678. Ought, 2022 — cited in Chapter 8: Scalable Oversight
  679. Our World in Data, 2024 — cited in Chapter 1: Capabilities
  680. Our World in Data, 2026 — cited in Chapter 1: Capabilities
  681. Owen, 2025 — cited in Chapter 1: Capabilities
  682. OWID, 2025 — cited in Chapter 2: Risks
  683. OWID, 2025 — cited in Chapter 2: Risks
  684. Oxford Reference, 2016 — cited in Chapter 5: Evaluations
  685. Oxford Union Debate, 2024 — cited in Chapter 2: Risks
  686. O’Brien et al., 2024 — cited in Chapter 4: Governance
  687. O’Keefe, 2020 — cited in Chapter 4: Governance
  688. Pacchiardi et al., 2023 — cited in Chapter 5: Evaluations
  689. Pacchiardi et al., 2025 — cited in Chapter 1: Capabilities
  690. Pace, 2020 — cited in Chapter 3: Strategies
  691. Pan et al., 2020 — cited in Chapter 6: Specification Gaming
  692. Pan et al., 2023 — cited in Chapter 5: Evaluations
  693. Panel of Experts on Libya, 2021 — cited in Chapter 2: Risks
  694. Pang et al., 2021 — cited in Chapter 8: Scalable Oversight
  695. Pannu et al., 2024 — cited in Chapter 2: Risks
  696. Papagiannidis, 2025 — cited in Chapter 4: Governance
  697. Papyshev et al., 2023 — cited in Chapter 4: Governance
  698. Park et al., 2023 — cited in Chapter 2: Risks, Chapter 3: Strategies
  699. Parrish et al., 2022 — cited in Chapter 8: Scalable Oversight
  700. Parrish et al., 2022 — cited in Chapter 8: Scalable Oversight
  701. Patel, 2023 — cited in Chapter 4: Governance
  702. PauseAI, 2023 — cited in Chapter 3: Strategies
  703. PauseAI, 2025 — cited in Chapter 2: Risks, Chapter 3: Strategies
  704. Pearson et al., 2023 — cited in Chapter 1: Capabilities
  705. Peng & Shang, 2024 — cited in Chapter 7: Goal Misgeneralization
  706. Peng et al.,2024 — cited in Chapter 5: Evaluations
  707. Peppin et al., 2024 — cited in Chapter 2: Risks
  708. Perez et al., 2022 — cited in Chapter 2: Risks
  709. Perez et al., 2022 — cited in Chapter 5: Evaluations, Chapter 6: Specification Gaming
  710. Perez et al., 2022 — cited in Chapter 5: Evaluations
  711. Perlman, 2024 — cited in Chapter 5: Evaluations
  712. Petillo et al., 2025 — cited in Chapter 7: Goal Misgeneralization
  713. Petrie et al., 2024 — cited in Chapter 4: Governance
  714. Petropoulos et al., 2025 — cited in Chapter 4: Governance
  715. Phan et al., 2025 — cited in Chapter 5: Evaluations
  716. Phuong et al., 2024 — cited in Chapter 4: Governance, Chapter 5: Evaluations
  717. Pilz & Heim, 2023 — cited in Chapter 4: Governance
  718. Pilz et al., 2025 — cited in Chapter 4: Governance
  719. Piper, 2023 — cited in Chapter 5: Evaluations
  720. Pistillo, 2025 — cited in Chapter 4: Governance
  721. Pistillo, 2025 — cited in Chapter 4: Governance
  722. Pope, 2023 — cited in Chapter 3: Strategies
  723. Potlogea and Ho, 2025 — cited in Chapter 2: Risks
  724. Power et al., 2022 — cited in Chapter 3: Strategies
  725. Prime Intellect, 2024 — cited in Chapter 3: Strategies
  726. Prime Intellect, 2025 — cited in Chapter 3: Strategies, Chapter 4: Governance
  727. Purtova et al., 2022 — cited in Chapter 4: Governance
  728. Qin et al., 2023 — cited in Chapter 1: Capabilities
  729. Qin et al., 2024 — cited in Chapter 2: Risks
  730. Radhakrishnan et al., 2023 — cited in Chapter 3: Strategies
  731. Rae et al., 2022 — cited in Chapter 1: Capabilities
  732. Rafailov et al., 2023 — cited in Chapter 6: Specification Gaming
  733. Rahaman et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  734. Raji et al., 2020 — cited in Chapter 4: Governance
  735. Rapaport, 2020 — cited in Chapter 1: Capabilities
  736. Rational Animations, 2025 — cited in Chapter 8: Scalable Oversight
  737. Rational Animations, 2025 — cited in Chapter 8: Scalable Oversight
  738. Reed et al., 2022 — cited in Chapter 1: Capabilities
  739. Rein et al., 2023 — cited in Chapter 5: Evaluations
  740. Ren & Sutherland, 2024 — cited in Chapter 7: Goal Misgeneralization
  741. Ren et al., 2024 — cited in Chapter 2: Risks, Chapter 3: Strategies, Chapter 4: Governance, Chapter 5: Evaluations
  742. Reuel & Bucknall, 2024 — cited in Chapter 4: Governance
  743. Reuel & Bucknall, 2024 — cited in Chapter 4: Governance
  744. Reuel et al., 2024 — cited in Chapter 4: Governance
  745. Riché et al., 2024 — cited in Chapter 5: Evaluations
  746. Rivera et al., 2024 — cited in Chapter 2: Risks
  747. Roberts et al., 2024 — cited in Chapter 4: Governance
  748. Rodriguez, 2020 — cited in Chapter 2: Risks
  749. Roger & Greenblatt, 2023 — cited in Chapter 3: Strategies
  750. Roger & Shlegeris, 2024 — cited in Chapter 5: Evaluations
  751. Roger et al., 2023 — cited in Chapter 5: Evaluations
  752. Roger, 2023 — cited in Chapter 3: Strategies
  753. Roger, 2023 — cited in Chapter 3: Strategies
  754. Rogers Commission, 1986 — cited in Chapter 2: Risks
  755. Rolls et al., 1980 — cited in Chapter 2: Risks
  756. Rudner et al., 2021 — cited in Chapter 3: Strategies
  757. Rumbelow & Watkins, 2023 — cited in Chapter 3: Strategies
  758. Russel & Norvig, 1994 — cited in Chapter 2: Risks
  759. SaferAI, 2025 — cited in Chapter 3: Strategies
  760. SaferAI, 2025 — cited in Chapter 3: Strategies
  761. SakanaAI, 2024 — cited in Chapter 1: Capabilities, Chapter 2: Risks
  762. SakanaAI, 2025 — cited in Chapter 3: Strategies
  763. Sandbrink, 2023 — cited in Chapter 2: Risks
  764. Sandoval-Segura et al., 2022 — cited in Chapter 2: Risks
  765. Santurkar et al., 2023 — cited in Chapter 6: Specification Gaming
  766. Sastry et al., 2024 — cited in Chapter 4: Governance
  767. Saunders et al., 2022 — cited in Chapter 8: Scalable Oversight
  768. Scherlis et. al. 2024 — cited in Chapter 8: Scalable Oversight
  769. Scherlis, 2023 — cited in Chapter 7: Goal Misgeneralization
  770. Scheurer et al., 2022 — cited in Chapter 6: Specification Gaming
  771. Scheurer et al., 2024 — cited in Chapter 5: Evaluations
  772. Schick et al., 2023 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  773. Schneider & McGrew, 2018 — cited in Chapter 1: Capabilities
  774. Schrimpf et al., 2021 — cited in Chapter 1: Capabilities
  775. Schuett et al., 2024 — cited in Chapter 4: Governance
  776. Schuett, 2022 — cited in Chapter 3: Strategies, Chapter 4: Governance
  777. Schuett, 2023 — cited in Chapter 4: Governance
  778. Schwarzschild et al., 2021 — cited in Chapter 2: Risks
  779. Schäfer et al., 2022 — cited in Chapter 4: Governance
  780. Sclar et al., 2023 — cited in Chapter 5: Evaluations
  781. Searle, 1980 — cited in Chapter 1: Capabilities
  782. Seger et al., 2023 — cited in Chapter 3: Strategies, Chapter 4: Governance
  783. Seger et al., 2023 — cited in Chapter 4: Governance
  784. Segerie & Gédéon, 2024 — cited in Chapter 2: Risks
  785. Segerie & Kolly, 2023 — cited in Chapter 3: Strategies
  786. Segerie, 2024 — cited in Chapter 3: Strategies
  787. Segerie, 2025 — cited in Chapter 3: Strategies
  788. Sener & Koltun, 2019 — cited in Chapter 7: Goal Misgeneralization
  789. Sevilla et. al., 2024 — cited in Chapter 1: Capabilities, Chapter 4: Governance
  790. Sevilla, 2025 — cited in Chapter 3: Strategies
  791. Sevilla, 2025 — cited in Chapter 3: Strategies
  792. Sevilla, AXRP Podcast, 2024 — cited in Chapter 1: Capabilities
  793. Shah et al., 2020 — cited in Chapter 7: Goal Misgeneralization
  794. Shah et al., 2025 — cited in Chapter 2: Risks
  795. Shao et al., 2024 — cited in Chapter 5: Evaluations
  796. Shapira, 2025 — cited in Chapter 3: Strategies
  797. Sharkey, 2023 — cited in Chapter 7: Goal Misgeneralization
  798. Sharkey, 2024 — cited in Chapter 5: Evaluations
  799. Shavit, 2023 — cited in Chapter 4: Governance
  800. Shayegani et al., 2023 — cited in Chapter 2: Risks
  801. Shen et al., 2023 — cited in Chapter 5: Evaluations
  802. Shevlane & Dafoe, 2020 — cited in Chapter 3: Strategies
  803. Shevlane et al., 2023 — cited in Chapter 3: Strategies, Chapter 5: Evaluations, Chapter 6: Specification Gaming
  804. Shevlane et al., 2023 — cited in Chapter 4: Governance
  805. Shevlane, 2024 — cited in Chapter 4: Governance
  806. Shi et al., 2022 — cited in Chapter 5: Evaluations
  807. Shimi, 2020 — cited in Chapter 7: Goal Misgeneralization
  808. Shinn et al., 2023 — cited in Chapter 1: Capabilities
  809. Shlegeris, 2022 — cited in Chapter 3: Strategies
  810. Shlegeris, 2024 — cited in Chapter 3: Strategies
  811. Shokri et al., 2017 — cited in Chapter 2: Risks
  812. Siegmann & Anderljung 2022 — cited in Chapter 4: Governance
  813. Simmons-Edler et al., 2024 — cited in Chapter 2: Risks
  814. Skare et al., 2024 — cited in Chapter 4: Governance
  815. Slattery et al., 2024 — cited in Chapter 2: Risks, Chapter 3: Strategies
  816. Snyder et al., 2020 — cited in Chapter 3: Strategies
  817. Soares, 2022 — cited in Chapter 3: Strategies, Chapter 7: Goal Misgeneralization
  818. Soares, 2023 — cited in Chapter 2: Risks
  819. Soares, 2023 — cited in Chapter 2: Risks
  820. Soice et al., 2023 — cited in Chapter 2: Risks
  821. Solaiman et al., 2019 — cited in Chapter 3: Strategies
  822. Solaiman et al., 2023 — cited in Chapter 3: Strategies, Chapter 4: Governance
  823. Solaiman et al., 2024 — cited in Chapter 4: Governance
  824. Srivastava et al., 2022 — cited in Chapter 5: Evaluations
  825. Stacey, 2025 — cited in Chapter 4: Governance
  826. Stanford HAI, 2024 — cited in Chapter 4: Governance
  827. Stanford HAI, 2025 — cited in Chapter 2: Risks, Chapter 4: Governance
  828. Stanford HAI, 2025 — cited in Chapter 4: Governance
  829. Stanford, 2024 — cited in Chapter 4: Governance
  830. State of AI Report, 2023 — cited in Chapter 4: Governance
  831. Steiner, 2022 — cited in Chapter 3: Strategies
  832. Steinhardt, 2022 — cited in Chapter 2: Risks
  833. Steinhardt, 2022 — cited in Chapter 2: Risks
  834. Steinhardt, 2023 — cited in Chapter 2: Risks
  835. Steinhardt, 2023 — cited in Chapter 3: Strategies
  836. Steinhardt, 2024 — cited in Chapter 7: Goal Misgeneralization
  837. Stewart & Plotkin, 2012 — cited in Chapter 4: Governance
  838. Stix et al., 2025 — cited in Chapter 1: Capabilities, Chapter 4: Governance
  839. Sutton, 2019 — cited in Chapter 1: Capabilities
  840. Sutton, 2023 — cited in Chapter 3: Strategies
  841. Sutton, 2023 — cited in Chapter 3: Strategies
  842. SWE bench, 2025 — cited in Chapter 1: Capabilities
  843. Swenson & Chan, 2024 — cited in Chapter 4: Governance
  844. Takemoto, 2024 — cited in Chapter 6: Specification Gaming
  845. Tallberg et al., 2023 — cited in Chapter 4: Governance
  846. Tamirisa et al., 2024 — cited in Chapter 3: Strategies, Chapter 4: Governance
  847. Tanzer et al., 2024 — cited in Chapter 5: Evaluations
  848. Tegmark & Omohundro, 2023 — cited in Chapter 3: Strategies
  849. Tegmark, 2017 — cited in Chapter 3: Strategies
  850. Tegmark, 2023 — cited in Chapter 2: Risks
  851. Tegmark, 2024 — cited in Chapter 2: Risks
  852. The Bulletin, 2024 — cited in Chapter 2: Risks
  853. Tian et al., 2023 — cited in Chapter 1: Capabilities
  854. Tihanyi et al., 2024 — cited in Chapter 5: Evaluations
  855. TIME, 2024 — cited in Chapter 4: Governance
  856. Tong, 2023 — cited in Chapter 2: Risks
  857. Trajano & Ang, 2023 — cited in Chapter 4: Governance
  858. Trusilo, 2024 — cited in Chapter 4: Governance
  859. Truth Initiative, 2017 — cited in Chapter 2: Risks
  860. Tsoy & Konstantinov, 2024 — cited in Chapter 7: Goal Misgeneralization
  861. Turing, 1950 — cited in Chapter 1: Capabilities
  862. Turner & Tadepalli, 2022 — cited in Chapter 2: Risks
  863. Turner et al., 2019 — cited in Chapter 2: Risks, Chapter 3: Strategies
  864. Turner, 2022 — cited in Chapter 3: Strategies
  865. Turner, 2022 — cited in Chapter 7: Goal Misgeneralization
  866. Turner, 2023 — cited in Chapter 3: Strategies
  867. Turpin et al., 2023 — cited in Chapter 3: Strategies, Chapter 4: Governance, Chapter 8: Scalable Oversight
  868. U.K. government, 2023 — cited in Chapter 4: Governance
  869. Uesato et. al, 2022 — cited in Chapter 8: Scalable Oversight
  870. UK AISI, 2024 — cited in Chapter 5: Evaluations
  871. Urbina et al., 2022 — cited in Chapter 2: Risks
  872. US & UK AISI 2024 — cited in Chapter 5: Evaluations
  873. US & UK AISI, 2024 — cited in Chapter 5: Evaluations
  874. Vaintrob, 2023 — cited in Chapter 3: Strategies
  875. Valle-Pérez et al., 2019 — cited in Chapter 7: Goal Misgeneralization
  876. van der Weij et al., 2024 — cited in Chapter 5: Evaluations
  877. van der Weij, 2024 — cited in Chapter 5: Evaluations
  878. Variengien & Martinet, 2024 — cited in Chapter 4: Governance
  879. Villalobos et al., 2024 — cited in Chapter 1: Capabilities
  880. Villalobos et al., 2024 — cited in Chapter 1: Capabilities
  881. vTaiwan, 2023 — cited in Chapter 3: Strategies
  882. Wache, 2023 — cited in Chapter 3: Strategies
  883. Wan et al., 2024 — cited in Chapter 5: Evaluations
  884. Wang and Gleave et al., 2022 — cited in Chapter 1: Capabilities
  885. Wang et al., 2018 — cited in Chapter 5: Evaluations
  886. Wang et al., 2019 — cited in Chapter 5: Evaluations
  887. Wang et al., 2023 — cited in Chapter 1: Capabilities, Chapter 5: Evaluations
  888. Wang et al., 2023 — cited in Chapter 5: Evaluations
  889. Wang et al., 2024 — cited in Chapter 1: Capabilities
  890. Wang et al., 2024 — cited in Chapter 7: Goal Misgeneralization
  891. Wang et al., 2025 — cited in Chapter 5: Evaluations
  892. Wasil et al., 2024 — cited in Chapter 3: Strategies
  893. Wasil et al., 2024 — cited in Chapter 4: Governance
  894. Wasil, 2022 — cited in Chapter 3: Strategies
  895. Wei et al., 2022 — cited in Chapter 1: Capabilities, Chapter 4: Governance
  896. Wei et al., 2022 — cited in Chapter 5: Evaluations, Chapter 8: Scalable Oversight
  897. Weidinger et al., 2021 — cited in Chapter 2: Risks
  898. Weidinger et al., 2023 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  899. Wentworth, 2022 — cited in Chapter 3: Strategies
  900. Wentworth, 2022 — cited in Chapter 8: Scalable Oversight
  901. Wentworth, 2025 — cited in Chapter 3: Strategies
  902. Wentworth, 2025 — cited in Chapter 3: Strategies
  903. Wentworth, 2025 — cited in Chapter 3: Strategies
  904. Whitehouse, 2025 — cited in Chapter 2: Risks
  905. Whitehouse, 2025 — cited in Chapter 2: Risks
  906. Wijk, 2023 — cited in Chapter 3: Strategies
  907. Wikipedia, 2022 — cited in Chapter 1: Capabilities
  908. Williams et al., 2025 — cited in Chapter 2: Risks
  909. Willis et al., 2024 — cited in Chapter 2: Risks
  910. Wiseman & McClements, 2025 — cited in Chapter 8: Scalable Oversight
  911. Wojton et al., 2020 — cited in Chapter 4: Governance
  912. Wolf et al., 2024 — cited in Chapter 6: Specification Gaming
  913. Wongkamjan et al., 2024 — cited in Chapter 5: Evaluations
  914. Wooldridge, 2021 — cited in Chapter 1: Capabilities
  915. Wooldridge, 2024 — cited in Chapter 2: Risks
  916. WorldCoin, 2024 — cited in Chapter 2: Risks
  917. Wu et al., 2021 — cited in Chapter 8: Scalable Oversight
  918. Xiang, 2023 — cited in Chapter 2: Risks
  919. Xiao et al., 2021 — cited in Chapter 6: Specification Gaming
  920. Xu et al., 2022 — cited in Chapter 2: Risks
  921. Xu et al., 2024 — cited in Chapter 1: Capabilities
  922. Xu et al., 2025 — cited in Chapter 5: Evaluations
  923. Yampolskiy, 2024 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  924. Yampolsky; 2024 — cited in Chapter 2: Risks, Chapter 5: Evaluations
  925. Yang et al., 2022 — cited in Chapter 6: Specification Gaming, Chapter 8: Scalable Oversight
  926. Yang et al., 2023 — cited in Chapter 5: Evaluations
  927. Yao et al., 2023 — cited in Chapter 5: Evaluations
  928. Yap, 2024 — cited in Chapter 1: Capabilities
  929. Ye et al., 2021 — cited in Chapter 1: Capabilities, Chapter 6: Specification Gaming
  930. You et al., 2025 — cited in Chapter 1: Capabilities
  931. Yu et al., 2022 — cited in Chapter 1: Capabilities
  932. Yudkowsky, 2002 — cited in Chapter 3: Strategies
  933. Yudkowsky, 2002 — cited in Chapter 3: Strategies
  934. Yudkowsky, 2004 — cited in Chapter 3: Strategies
  935. Yudkowsky, 2007 — cited in Chapter 3: Strategies
  936. Yudkowsky, 2008 — cited in Chapter 3: Strategies
  937. Yudkowsky, 2013 — cited in Chapter 1: Capabilities
  938. Yudkowsky, 2015 — cited in Chapter 2: Risks
  939. Yudkowsky, 2022 — cited in Chapter 3: Strategies
  940. Yudkowsky, 2022 — cited in Chapter 3: Strategies
  941. Yudkowsky, 2022 — cited in Chapter 3: Strategies
  942. Yudkowsky, 2023 — cited in Chapter 3: Strategies
  943. Zaidan & Ibrahim, 2024 — cited in Chapter 4: Governance
  944. Zellers et al., 2018 — cited in Chapter 5: Evaluations
  945. Zellers et al., 2019 — cited in Chapter 5: Evaluations
  946. Zhang et al., 2017 — cited in Chapter 2: Risks
  947. Zhang et al., 2021 — cited in Chapter 4: Governance
  948. Zhang et al., 2021 — cited in Chapter 4: Governance
  949. Zhang et al., 2023 — cited in Chapter 8: Scalable Oversight
  950. Zhang et al., 2024 — cited in Chapter 3: Strategies, Chapter 5: Evaluations
  951. Zhang et al., 2024 — cited in Chapter 5: Evaluations
  952. Zhang et al., 2025 — cited in Chapter 4: Governance
  953. Zhao et al., 2024 — cited in Chapter 2: Risks
  954. Zhou et al., 2023 — cited in Chapter 5: Evaluations
  955. Zhou et al., 2024 — cited in Chapter 4: Governance
  956. Zhu et al., 2021 — cited in Chapter 2: Risks
  957. Zhu et al., 2024 — cited in Chapter 5: Evaluations
  958. Ziegler et al., 2020 — cited in Chapter 2: Risks
  959. Zou et al., 2023 — cited in Chapter 5: Evaluations
  960. Zuho et al., 2024 — cited in Chapter 5: Evaluations
  961. Zvi, 2025 — cited in Chapter 3: Strategies
  962. Özcan, 2024 — cited in Chapter 4: Governance