Tao Li

Tao Li

Assistant Professor

City University of Hong Kong

Research Interests

Game Theory
Control & Optimization
Reinforcement Learning

About

I am an assistant professor in the Department of Systems Engineering at City University of Hong Kong. I was a visiting researcher at the IBM Thomas J. Watson Research Center, collaborating with the Mathematical Sciences and Quantum Computing divisions in 2025. I earned my Ph.D. in Electrical and Computer Engineering from New York University, advised by Prof. Quanyan Zhu, where I also worked closely with Prof. Kaan Ozbay and Prof. Sundeep Rangan. My dissertation examines the triad of information, decision, and uncertainty in multi-agent learning. Prior to my doctoral studies, I conducted research in computational harmonic analysis under the supervision of Prof. Bin Han at the University of Alberta. I hold a B.S. in Mathematics, graduating summa cum laude from Xiamen University.

Research Overview

I develop learning and decision-making methods that help interacting agents operate reliably under uncertainty. My work connects game theory, control, and reinforcement learning, with a recent focus on agentic AI for secure and resilient cyber-physical systems in smart cities.

My Erdős Number is 3

Paul Erdős (0) coauthored "On changes of signs in infinite series" (1978) with Charles K. Chui (1), who coauthored "A dual-chain approach for bottom–up construction of wavelet filters with any integer dilation" (2012) with Bin Han (2), who coauthored "Directional compactly supported box spline tight framelets with simple geometric structure" (2019) with me (3).

Selected Publications

View All →

Stackelberg Coupling of Online Representation Learning and Reinforcement Learning

Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen

International Conference on Learning Representations (ICLR)2026

A Stackelberg-game framework for tackling the deadly triad in off-policy deep reinforcement learning, which models representation learning and Q-learning as two strategic agents in a hierarchical game

Model-Agnostic Hessian-Free Meta-Policy Optimization via Zeroth-Order Estimation: A Linear Quadratic Regulator Perspective

Yunian Pan, Tao Li, Quanyan Zhu

Dynamic Games and Applications2025

A Hessian-free meta-learning algorithm for ergodic Linear Quadratic Regulator (LQR) tasks is introduced, which directly approximates the meta-policy gradient with zeroth-order information via Gaussian smoothing and Stein’s identity.

Digital twin-based driver risk-aware predictive mobility analytics for real-time situational awareness through cooperative sensing

Tao Li, Zilin Bian, Haozhe Lei, Fan Zuo, Ya-Ting Yang, Quanyan Zhu, Zhenning Li, Zhibin Chen, Kaan Ozbay

IEEE Transactions on Intelligent Transportation Systems2025

An urban traffic digital twin system that includes AI-powered traffic sensing and event-triggered adaptive calibration, which provides driver-centric situational awareness and predicts network-wide mobility and safety risks in real time.

Adaptive security response strategies through conjectural online learning

Kim Hammar, Tao Li, Rolf Stadler, Quanyan Zhu

IEEE Transactions on Information Forensics and Security2025

A novel Conjectural Online Learning (COL) method for adaptive security response strategies in IT infrastructures, addressing model misspecification and uncertainty through Bayesian learning and rollout.

Multi-level traffic-responsive tilt camera surveillance through predictive correlated online learning

Tao Li, Zilin Bian, Haozhe Lei, Fan Zuo, Ya-Ting Yang, Quanyan Zhu, Zhenning Li, Kaan Ozbay

Transportation Research Part C: Emerging Technologies2024

An AI-powered pan-tilt camera-based traffic sensing system, composed of spatial-temporal graph transformer for real-time traffic estimation and camera control through distributed online convex optimization.

News

2026-07

🎤 I was invited to give a keynote talk at the 2026 AAAI Summer Symposium at Dongguk University in Seoul on our recent research in autonomous cyber defense agents, including this paper.

2026-02

🎉 Our paper on game-theoretic representation learning in deep RL has been accepted to ICLR 2026! By framing representation learning and reinforcement learning as two players in a Stackelberg game, we aim to address the deadly triad in off-policy deep RL.

2026-01

🏆 Call for Nominations! We are accepting nominations for IEEE Control Systems Society Security & Privacy Rising Star.