KAIST

< Professor Sooel Son, School of Computing >

KAIST (President Choongsik Bae) announced on the 28th of July that Professor Sooel Son has been selected as the only researcher in Korea to receive funding from Microsoft for research on artificial intelligence safety and security.

The funding was awarded through the External Red Team Alliance (EXTRA), a new program established by Microsoft’s AI Red Team, which examines the safety and security vulnerabilities of AI systems. EXTRA is a global initiative designed to strengthen AI safety and security research capabilities by supporting researchers at universities and technology experts around the world.

Microsoft noted that most AI safety testing is still conducted internally by individual companies or organizations. However, assessing the major risks posed by increasingly advanced AI systems requires expertise across a broad range of fields, including cybersecurity, multilingual environments, regional and cultural contexts, AI alignment, and potential misuse. EXTRA was launched in recognition of the difficulty a single internal organization faces when comprehensively evaluating these diverse risks.

Through the program, Microsoft will provide KAIST with an unrestricted gift of USD 25,000, approximately KRW 37 million, with no prescribed project period, to support research related to AI safety, security, alignment, and responsible AI development. The funding will be used to support Professor Son’s research team in its work on AI security and safety.

More than a dozen universities across six continents are participating in EXTRA, with KAIST being the only university selected from Korea. Through the program, Microsoft plans to expand the ecosystem for independent AI safety research and strengthen collaboration between academia and industry.

Professor Son’s research team has been conducting research on the security and privacy of AI systems that use machine-learning models and large language models. In particular, the team analyzes adversarial attacks against deep neural networks and language models—including model extraction, membership inference, personal information extraction, model inversion, machine unlearning, and prompt injection—and develops defense methodologies to assess and improve model safety.

Building on these technologies, the team is also focusing on establishing systematic defense methodologies that enable the safe and trustworthy deployment of agentic AI systems operating in real-world service environments, including web agents and agentic browsers.

“As AI systems rapidly spread throughout society, research that verifies the security and reliability of increasingly advanced AI is becoming more important,” said Professor Son. “Our participation in Microsoft AI Red Team’s EXTRA program will provide an opportunity to further advance our research on the safe development and use of AI systems.”

“AI safety research has never been more important, and universities have a critical role to play in advancing the field,” said Ram Shankar Siva Kumar, who leads the Microsoft AI Red Team. “Through EXTRA, we aim to support researchers working to deepen our understanding of how increasingly powerful AI systems can be evaluated, protected, and governed responsibly.”

“Competition in AI technology is expanding beyond performance to encompass safety and trustworthiness,” said KAIST President Choongsik Bae. “KAIST’s participation as the only Korean research institution in Microsoft’s global AI safety research network is a meaningful achievement that demonstrates Korea’s competitiveness in AI research. We will continue to lead the advancement of responsible AI technologies that everyone can trust and use by pursuing world-class research in AI safety and security.”