Resources & Opportunities

People from a wide range of backgrounds can make important contributions to safe AI development. We’ve collected resources here that can help you to build expertise, find opportunities and stay up to date on developments in AI. We include both general resources and resources tailored to specific areas of expertise. Please note that the opportunities listed here are far from exhaustive and are intended to provide a starting point for deeper exploration.

Apply
Curriculum
Facilitate Course
Introduction to AI Safety Ethics, and Society

Take Action

Introduction to AI Safety Ethics, and Society background texture

General resources

Jobs and fellowships

Job Boards

Fellowships

Grants

Boards

Featured Grant Programs

Other Grantors

Resources to learn more

Newsletters:

Podcasts:

Resources by field

China Studies

As a leading player in AI research and development, China is a key international stakeholder influencing the global dynamics of competition and cooperation in AI. Expertise in Chinese research, institutions, and strategic priorities is increasingly important to effectively navigate the evolving landscape of international AI governance.

Career Guides and General Resources:

Research Fellowships and Grants:

Note: there are no fellowships that we are aware of specific to researching China and AI. But, the following opportunities are available to either study China (and focus on AI Policy/NatSec), or study AI Policy/NatSec (and focus on China).

Resources to Learn More

Communications and Media

Communications and media professionals play an important role in engaging the general public and specific influential groups with questions around AI’s impacts and potential risks. Through a variety of formats, including journalism, newsletters, books, films, TV, podcasts, and social media, talented communicators can make developments in AI clear and accessible to a range of audiences and direct attention towards important questions and challenges.

Research Fellowships and Grants:

Media Examples:

Newsletters:

Computer Hardware

Computer hardware specialists can play an essential role in AI research and governance. For example, they can help us to understand and forecast progress in AI, or to develop AI policies that are well-designed and grounded in the technical details of AI hardware, such as secure governance mechanisms for high-performance AI chips. Given the policy implications of this work, also consider checking out the opportunities and resources in the Policy, Law, and International Relations section.

Career Guides and General Resources:

Funders interested in supporting work on AI Hardware:

Relevant Organizations:

Resources to Learn More

Cybersecurity

As AI systems become more powerful, this is likely to lower the barrier to cyber-offense operations, which could have destabilizing impacts on the overall offense-defense balance in cyberspace. However, AI can also strengthen defenders if deployed judiciously. Securing powerful AI systems against attacks is critical to preventing model theft and the potential proliferation of systems that could empower malicious users. We need cybersecurity experts who understand AI’s unique risks and can safeguard its development and deployment.

Career Guides and General Resources:

Jobs and Internships:

Fellowships and Grants:

Resources and Reports:‍

Economics

AI has the potential to reshape the global economy, but research at the intersection of economics and transformative AI is still in its very early stages. Economists are needed to conduct groundbreaking work in forecasting AI-driven economic outcomes. Given the strong ties between economics and policy, we also recommend exploring the opportunities in policy, law, and international relations.

Resources to Learn More

Life Sciences and Biosecurity

As AI advances, its applications in biology may exacerbate the potential for catastrophic risks, such as through empowering individuals or nations to bioengineer novel pathogens. Experts at the intersection of biosecurity and AI safety are crucial for identifying, understanding, and mitigating these emerging threats.

Career Guides and General Resources:

Fellowships, Grants, and Other Opportunities:

Resources to Learn More

Machine Learning

AI safety relies on talented machine learning engineers and researchers with strong technical expertise to identify and test novel research directions. Those with an ML background can also consider other areas such such as policy, where technical understanding is relatively scarce but highly valuable.

Career Guides and General Resources:

Jobs and Internships:

Fellowships and Grants:

Resources to Learn More

Policy, Law, and International Relations

AI safety is as much a policy challenge as a technical one. Strong governance, both domestically and internationally, is crucial to ensuring safe AI development and deployment. Experts from policy, law, and international relations can bridge the gap between technology and governance, for example by developing policy proposals or advising lawmakers.

Career Guides and General Resources:

Policy Research Fellowships and Grants:

Resources to Learn More

Get Involved
How to take actionExpress course interestVirtual courseFacilitateSubmit feedback
Textbook Resources
Start reading
Textbook audiobook
Table of contentsDownload textbookContent for curriculum
Terms of servicePrivacy policy

Citation:
Dan Hendrycks. Introduction to AI Safety, Ethics and Society. Taylor & Francis, (2024). ISBN: 9781032798028. URL: www.aisafetybook.com

Cookies Notice: This website uses cookies to identify pages that are being used most frequently. This helps us analyze data about web page traffic and improve our website. We only use this information for the purpose of statistical analysis and then the data is removed from the system. We do not and will never sell user data. Read more about our cookie policy on our privacy policy. Please contact us if you have any questions.

© 2025 Center for AI Safety
Built by ODW
Join the AISES course
Take action
Course overview
Curriculum
Buy print edition
Download textbook
1. Overview of Catastrophic AI Risks
0.1
Preface
1.1
Overview of Catastrophic AI Risks
1.2
Malicious Use
1.3
AI Race
1.4
Organizational Risks
1.5
Rogue AIs
1.6
Discussion of Connections Between Risks
2. AI Fundamentals
2.1
AI Fundamentals
2.2
Artificial Intelligence & Machine Learning
2.3
Deep Learning
2.4
Scaling Laws
2.5
Speed of AI Development
2.6
AI Fundamentals Conclusion
3. Single Agent Safety
3.1
Single Agent Safety
3.2
Monitoring
3.3
Robustness
3.4
Alignment
3.5
Systemic Safety
3.6
Safety and General Capabilities
3.7
Conclusion
4. Safety Engineering
4.1
Safety Engineering
4.2
Risk Decomposition
4.3
Nines of Reliability
4.4
Safe Design Principles
4.5
Component Failure Accident Models and Methods
4.6
Systemic Factors
4.7
Tail Events and Black Swans
4.8
Conclusion
5. Complex Systems
5.1
Complex Systems
5.2
Introduction to Complex Systems
5.3
Complex Systems for AI Safety
5.4
Conclusion
6. Beneficial AI and Machine Ethics
6.1
Beneficial AI and Machine Ethics
6.2
Law
6.3
Fairness
6.4
The Economic Engine
6.5
Wellbeing
6.6
Preferences
6.7
Happiness
6.8
Social Welfare Functions
6.9
Moral Uncertainty
7. Collective Action Problems
7.1
Collective Action Problems
7.2
Game Theory
7.3
Cooperation
7.4
Conflict
7.5
Evolutionary Pressures
7.6
Conclusion
8. Governance
8.1
Governance
8.2
Growth
8.3
Distribution
8.4
Corporate Governance
8.5
National Governance
8.6
International Governance
8.7
Compute Governance
8.8
Conclusion
9. Appendices
9.1
App. A: Normative Ethics
10.1
App. B: Utility Functions
11.1
App. C: Reinforcement Learning
12.1
App. D: Long-Tailed and Thin-Tailed Distributions
13.1
App. E: Evolutionary Game Theory
14.1
App. F: Other Cooperation Mechanisms
15.1
App. G: Intrasystem Conflict Causes
16.1
Acknowledgements