About
I am an assistant professor in the Department of Systems Engineering at City University of Hong Kong. I was a visiting researcher at the IBM Thomas J. Watson Research Center, collaborating with the Mathematical Sciences and Quantum Computing divisions in 2025. I earned my Ph.D. in Electrical and Computer Engineering from New York University, advised by Prof. Quanyan Zhu, where I also worked closely with Prof. Kaan Ozbay and Prof. Sundeep Rangan. My dissertation examines the triad of information, decision, and uncertainty in multi-agent learning. Prior to my doctoral studies, I conducted research in computational harmonic analysis under the supervision of Prof. Bin Han at the University of Alberta. I hold a B.S. in Mathematics, graduating summa cum laude from Xiamen University.
Research Overview
I develop learning and decision-making methods that help interacting agents operate reliably under uncertainty. My work connects game theory, control, and reinforcement learning, with a recent focus on agentic AI for secure and resilient cyber-physical systems in smart cities.
- Multi-agent learning: How agents learn and coordinate when information is incomplete or asymmetric.
- Autonomous cybersecurity: How AI agents make transparent and accountable security decisions.
- Resilient cyber-physical systems: How networked systems remain robust to uncertainty and disruption.
My Erdős Number is 3
Paul Erdős (0) coauthored "On changes of signs in infinite series" (1978) with Charles K. Chui (1), who coauthored "A dual-chain approach for bottom–up construction of wavelet filters with any integer dilation" (2012) with Bin Han (2), who coauthored "Directional compactly supported box spline tight framelets with simple geometric structure" (2019) with me (3).
Selected Publications
View All →Stackelberg Coupling of Online Representation Learning and Reinforcement Learning
Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen
International Conference on Learning Representations (ICLR)2026
A Stackelberg-game framework for tackling the deadly triad in off-policy deep reinforcement learning, which models representation learning and Q-learning as two strategic agents in a hierarchical game
Model-Agnostic Hessian-Free Meta-Policy Optimization via Zeroth-Order Estimation: A Linear Quadratic Regulator Perspective
Yunian Pan, Tao Li, Quanyan Zhu
Dynamic Games and Applications2025
A Hessian-free meta-learning algorithm for ergodic Linear Quadratic Regulator (LQR) tasks is introduced, which directly approximates the meta-policy gradient with zeroth-order information via Gaussian smoothing and Stein’s identity.
Digital twin-based driver risk-aware predictive mobility analytics for real-time situational awareness through cooperative sensing
Tao Li, Zilin Bian, Haozhe Lei, Fan Zuo, Ya-Ting Yang, Quanyan Zhu, Zhenning Li, Zhibin Chen, Kaan Ozbay
IEEE Transactions on Intelligent Transportation Systems2025
An urban traffic digital twin system that includes AI-powered traffic sensing and event-triggered adaptive calibration, which provides driver-centric situational awareness and predicts network-wide mobility and safety risks in real time.
Adaptive security response strategies through conjectural online learning
Kim Hammar, Tao Li, Rolf Stadler, Quanyan Zhu
IEEE Transactions on Information Forensics and Security2025
A novel Conjectural Online Learning (COL) method for adaptive security response strategies in IT infrastructures, addressing model misspecification and uncertainty through Bayesian learning and rollout.
Multi-level traffic-responsive tilt camera surveillance through predictive correlated online learning
Tao Li, Zilin Bian, Haozhe Lei, Fan Zuo, Ya-Ting Yang, Quanyan Zhu, Zhenning Li, Kaan Ozbay
Transportation Research Part C: Emerging Technologies2024
An AI-powered pan-tilt camera-based traffic sensing system, composed of spatial-temporal graph transformer for real-time traffic estimation and camera control through distributed online convex optimization.
News
🎤 I was invited to give a keynote talk at the 2026 AAAI Summer Symposium at Dongguk University in Seoul on our recent research in autonomous cyber defense agents, including this paper.
🎉 Our paper on game-theoretic representation learning in deep RL has been accepted to ICLR 2026! By framing representation learning and reinforcement learning as two players in a Stackelberg game, we aim to address the deadly triad in off-policy deep RL.
🏆 Call for Nominations! We are accepting nominations for IEEE Control Systems Society Security & Privacy Rising Star.
