AI Safety Research

Multi-Agent
AI Safety
for Democracy

A nonprofit research organization led by Prof. Zhijing Jin, aiming to advance AI safety and security through rigorous research, threat assessment, and mitigation strategies.

Our Mission

AI systems are rapidly becoming central to economic infrastructure and high-stakes decision-making.

As multi-agent AI systems interact in markets, supply chains, and critical services, they create complex emergent dynamics that are difficult to predict or control. Our research focuses on identifying and mitigating these systemic risks to ensure AI deployment remains safe and aligned with human values as these systems scale.

About Us

EuroSafeAI focuses on research in the areas of AI safety, security, and multi-agent systems.

We advance AI safety and security by developing risk assessments and mitigation strategies. We target scenarios where AI systems may act contrary to developer intent. We value curiosity, ethics, and a proactive, responsible mindset.

Research Focus

Our Three Pillars

We focus on critical areas of AI safety to ensure advanced systems remain beneficial and aligned with human values.

View our research

Frontier AI Safety Research

Our broader agenda includes safeguarding and post-training LLMs against harmful use cases, interpreting model behavior via internal states, and detecting model misalignment tendencies.

New Publication

AI Poses Risks to Democratic and Social Systems

We identify seven failure modes through which AI poses risks to social systems — from belief homogenization and epistemic floods to power concentration and normative centralization — and argue that AI safety must complement model-level benchmarks with system-level evaluation that captures these aggregate institutional effects.

Zhijing Jin, Yoshua Bengio, Stuart Russell, Audrey Tang, Bernhard Schölkopf, Rada Mihalcea, Roger Grosse + 22 co-authors

View Paper
AI Poses Risks to Democratic and Social Systems — paper preview

Collaborations

Our Collaborators

We collaborate with leading research labs, governments, and foundations to advance AI safety on a global scale.

University of TorontoETH ZurichMax Planck Institute for Intelligent SystemsUK AISIUniversity of MichiganSchwartz Reisman Institute - University of Toronto

Join Our Mission

We're looking for talented researchers and professionals who are passionate about ensuring AI benefits humanity.