Publications
A collection of selected research works. Check my Google Scholar for the latest update.
19 of 19 publications
Hierarchical Agentic Incident Response with Digital-Twin-Validated Attack Inference
Yiran Gao, Juntao Chen, Tao Li
IEEE Conference on Communications and Network Security (CNS)2026
A hierarchical agentic incident-response framework that combines LLM-based attack inference, rollout planning, and digital-twin validation to improve reliable recovery from multi-stage cyberattacks.
Collaborative Cloud-Edge Computing via LLM-Guided Constrained Reinforcement Learning
Yuhui Wang, Xingqi Wu, Junaid Farooq, Tao Li, Juntao Chen
IEEE 37th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)2026
An LLM-guided constrained reinforcement learning method for scalable cloud-edge task offloading and resource allocation, combining action demonstrations, reward shaping, and probabilistic action sampling.
In-Context Reinforcement Learning via Communicative World Models
Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen
Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence (IJCAI-26)2026
CORAL formulates in-context reinforcement learning as emergent communication, using a pre-trained world-model agent to provide transferable context for sample-efficient and zero-shot adaptation.
In-Context Autonomous Network Incident Response: An End-to-End Large Language Model Agent Approach
Yiran Gao, Kim Hammar, Tao Li
Proceedings of the AAAI Symposium Series2026
An end-to-end LLM agent for autonomous network incident response that unifies perception, attack-model reasoning, response planning, and action with in-context adaptation.
Delay-Aware Reinforcement Learning for O-RAN Control Under Stochastic Reward Feedback
Xingqi Wu, Junaid Farooq, Tao Li, Juntao Chen, Ying Wang
IEEE Networking Letters2026
A delay-aware deep RL framework for O-RAN control that uses LSTM-based delay prediction and temporal reward realignment to stabilize learning under stochastic feedback latency.
Distributed Online Convex Optimization With Nonseparable Costs and Constraints
Zhaoye Pan, Haozhe Lei, Fan Zuo, Zilin Bian, Tao Li
IEEE Control Systems Letters2026
A distributed online convex optimization framework for networked decision-making with nonseparable costs and constraints, enabling coordinated learning under coupled objectives.
Stackelberg Coupling of Online Representation Learning and Reinforcement Learning
Fernando Martinez, Tao Li, Yingdong Lu, Juntao Chen
International Conference on Learning Representations (ICLR)2026
A Stackelberg-game framework for tackling the deadly triad in off-policy deep reinforcement learning, which models representation learning and Q-learning as two strategic agents in a hierarchical game
Model-Agnostic Hessian-Free Meta-Policy Optimization via Zeroth-Order Estimation: A Linear Quadratic Regulator Perspective
Yunian Pan, Tao Li, Quanyan Zhu
Dynamic Games and Applications2025
A Hessian-free meta-learning algorithm for ergodic Linear Quadratic Regulator (LQR) tasks is introduced, which directly approximates the meta-policy gradient with zeroth-order information via Gaussian smoothing and Stein’s identity.
Symbiotic Game and Foundation Models for Cyber Deception Operations in Strategic Cyber Warfare
Tao Li, Quanyan Zhu
Foundations of Cyber Deception2025
A comprehensive discussion on the role of game-theoretic models and foundation models in cyber deception operations within strategic cyber warfare, highlighting their symbiotic relationship in automated cyber defense mechanisms.
Digital twin-based driver risk-aware predictive mobility analytics for real-time situational awareness through cooperative sensing
Tao Li, Zilin Bian, Haozhe Lei, Fan Zuo, Ya-Ting Yang, Quanyan Zhu, Zhenning Li, Zhibin Chen, Kaan Ozbay
IEEE Transactions on Intelligent Transportation Systems2025
An urban traffic digital twin system that includes AI-powered traffic sensing and event-triggered adaptive calibration, which provides driver-centric situational awareness and predicts network-wide mobility and safety risks in real time.
Transparent tagging for strategic social nudges on user-generated misinformation
Ya-Ting Yang, Tao Li, Quanyan Zhu
IEEE Transactions on Network Science and Engineering2025
This paper establishes a Bayesian persuaded branching process to study social network platforms' (SNP) tagging policy design under misdetection of misinformation.
Adaptive security response strategies through conjectural online learning
Kim Hammar, Tao Li, Rolf Stadler, Quanyan Zhu
IEEE Transactions on Information Forensics and Security2025
A novel Conjectural Online Learning (COL) method for adaptive security response strategies in IT infrastructures, addressing model misspecification and uncertainty through Bayesian learning and rollout.
Digital twin-enhanced wireless indoor navigation: Achieving efficient environment sensing with zero-shot reinforcement learning
Tao Li, Haozhe Lei, Hao Guo, Mingsheng Yin, Yaqi Hu, Quanyan Zhu, Sundeep Rangan
IEEE Open Journal of the Communications Society2025
A physics-informed reinforcement learning (PIRL) approach leveraging digital twins for efficient and generalizable wireless indoor navigation using mmWave signals, achieving zero-shot generalization in unseen environments.
Multi-level traffic-responsive tilt camera surveillance through predictive correlated online learning
Tao Li, Zilin Bian, Haozhe Lei, Fan Zuo, Ya-Ting Yang, Quanyan Zhu, Zhenning Li, Kaan Ozbay
Transportation Research Part C: Emerging Technologies2024
An AI-powered pan-tilt camera-based traffic sensing system, composed of spatial-temporal graph transformer for real-time traffic estimation and camera control through distributed online convex optimization.
Decision-dominant strategic defense against lateral movement for 5G zero-trust multi-domain networks
Tao Li, Yunian Pan, Quanyan Zhu
Network Security Empowered by Artificial Intelligence2024
A proactive end-to-end security mechanism for 5G-enabled multi-domain communication networks, utilizing decision-dominant learning to prevent lateral movement of adversaries within a zero-trust architecture.
Game-theoretic distributed empirical risk minimization with strategic network design
Shutian Liu, Tao Li, Quanyan Zhu
IEEE Transactions on Signal and Information Processing over Networks2023
A game-theoretic framework for distributed empirical risk minimization (ERM) problems over networks where nodes strategically choose both learning parameters and network structure to optimize performance.
The role of information structures in game-theoretic multi-agent learning
Tao Li, Yuhan Zhao, Quanyan Zhu
Annual Reviews in Control2022
A comprehensive examination of multi-agent learning (MAL) from the perspective of information structures, proposing a taxonomy based on information, belief, and policy generation mechanisms.
The confluence of networks, games, and learning a game-theoretic framework for multiagent decision making over networks
Tao Li, Guanze Peng, Quanyan Zhu, Tamer Başar
IEEE Control Systems2022
A comprehensive review of game-theoretic multiagent decision making over networks, developing a unified dynamical-system viewpoint of reinforcement learning and control & optimization over networks, highlighting its applications and the growing interest in complex network systems.
Directional compactly supported box spline tight framelets with simple geometric structure
Bin Han, Tao Li, Xiaosheng Zhuang
Applied Mathematics Letters2019
A directional compactly supported box spline tight framelet with simple geometric structure is built such that all the high-pass filters in its underlying tight framelet filter bank have only two nonzero coefficients with opposite signs.