Senior Researcher - Civil Safety Sciences
Job description
A research role in CARMA's Civil Safety Sciences program focused on anticipating novel AI-enabled hazard classes and advancing detection sciences, response protocols, and resilience technologies. The position runs projects with significant intellectual autonomy under the Executive Director.
At a glance
- Employment
- Full-time
- Work mode
- Remote
- Pay
- USD 155,000 – 215,000 / year
What you'll do
- Conduct structured horizon-scanning for novel AI-enabled hazard classes, and develop methodologies for reasoning rigorously about threats that lack historical base rates or established scientific communities
- Investigate next-generation detection sciences, such as dynamic and adaptive pathogen surveillance, and analogous open-ended approaches for other emerging hazard modalities
- Pursue feasibility analyses on deep resilience and lifeline capacities engineered to function when conventional infrastructure, sunlight, or centralized coordination cannot be assumed
- Analyze biosphere-scale vulnerabilities, including geoengineering, synthetic microbes for terraforming or remediation, and nontraditional environmental toxicology arising from AI-enabled activity
- Identify and selectively advance defensive, stabilizing, and transparency-enhancing technologies whose differential acceleration favors humanity
- Develop scientific metaresearch on how evidence is generated, aggregated, and translated into action where conventional empirical feedback loops are weak
- Build scientific coordination capacity through standards, convenings, and cross-border working relationships, and equip frontline responders and community networks with usable decision support
- Co-author grant applications, build analytical tools that make catastrophic risks more legible, and translate findings for policymakers, technical audiences, and the public
- Collaborate across CARMA programs to integrate civil safety perspectives with broader risk assessment, governance, and technical safety workstreams
What we're looking for
- Substantive familiarity with adversarial environments and adversarial reasoning, broadly construed: grounded in security studies, biosecurity, cybersecurity, defense analysis, red-teaming, safety engineering, dual-use technology assessment, or comparable experience reasoning rigorously about deliberate misuse and worst-case dynamics
- Demonstrated ability to reason carefully about hazards that lack robust historical data or settled detection paradigms
- 5+ years of relevant research or applied experience, with a track record of running independent projects from framing through delivery
- Strong publication record or equivalent body of work on technological risk, resilience, detection science, or related domains
- Excellent written and verbal communication, with proven ability to translate technical content for policymakers, funders, and non-specialist audiences
- Systems thinking and comfort with substantial uncertainty and rapidly shifting knowledge landscapes
- Substantive grounding in modern AI capabilities and trajectories, sufficient to anticipate how advancing AI reshapes threat and defense landscapes in your areas of work
- Self-directed, with sound judgment for identifying high-leverage problems under broad rather than micromanaged direction
Nice to have
- Interdisciplinary credentials bridging two or more of: biology, chemistry, physics, engineering, computer science, ecology, or public health
- Direct experience in biosurveillance, civil defense or emergency preparedness, food security, environmental monitoring, geoengineering analysis, biosafety, or critical infrastructure protection
- Background in scientific metaresearch, evidence synthesis, horizon scanning, structured expert elicitation, or foresight methodologies
- Experience with grant writing, science diplomacy, standards development, or convening dispersed research communities
- Skills in tool building, modeling, or dashboard development for risk visualization and decision support
- Track record of contributions to AI safety, AI governance, biosecurity policy, or adjacent fields
- Familiarity with cognitive and epistemic security, or experience working with frontline responders, mutual aid networks, or community-level resilience capacity
Your team
Civil Safety Sciences program
Advances the detection sciences, response protocols, and resilience technologies that let people, communities, and the biosphere better foresee, curtail, endure, and recover from civilizational shocks.
Apply
About Center for AI Risk Management & Alignment (CARMA)
CARMA works to help society navigate the complex and potentially catastrophic risks arising from increasingly powerful AI systems. It focuses on grounding AI risk management in rigorous analysis, developing policy frameworks that squarely address AGI, advancing technical safety approaches, and fostering global perspectives on durable safety. CARMA is a fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation.
Mission
To lower the risks to humanity and the biosphere from transformative AI.
Key facts
- Fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation