01 // About Me
I'm a first-year PhD student in Computer Science at the University of Manchester, co-supervised by Dr. Clara Cheung, Dr. Akilu Yunusa-Kaltungo, and Dr. Wei Pan. My study is generously funded by University of Manchester Bicentenary Scholarship.
Prior to my PhD, I worked as a research engineer at Huawei Noah's Ark Lab in London, working on AI agent research. Before this, I obtained my Master's degree in Robotics and Computation from University College London in 2024 and a Bachelor's degree in Automation from Beihang University in 2023.
I am always open to collaboration and research opportunities, and I am excited about working on cutting-edge research in industry.
Research Interests
Reinforcement Learning
Embodied Intelligence
AI Agent
02 // Timeline
PhD in Computer Science
University of Manchester
2026–Present
Research Engineer in AI Agent
Huawei Noah's Ark Lab, London
2024–2025
MSc in Robotics and Computation
University College London
2023–2024
Research Intern in Robotics
CASIA, Beijing
2022–2023
AI Engineer Intern in Computer Vision
Tencent Cloud, Beijing
2022
BEng in Automation
Beihang University
2019–2023
03 // Publications
01
Beyond Syntax: Action Semantics Learning for App Agents
Bohan Tang*, Dezhao Luo*, Jianheng Liu, Jingxuan Chen, Shaogang Gong, Jianye Hao, Jun Wang, Kun Shao
arXiv preprint, 2025
02
Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement Learning
Qingyuan Wu*, Jianheng Liu*, Jianye Hao, Jun Wang, Kun Shao
VLM4RWD Workshop on Annual Conference on Neural Information Processing Systems (NeurIPS), 2025
03
DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-device Control Agents
Taiyi Wang*, Zhihao Wu*, Jianheng Liu, Jianye Hao, Jun Wang, Kun Shao
International Conference on Learning Representations (ICLR), 2025
04
DreamerNav: Learning-Based Autonomous Navigation in Dynamic Indoor Environments Using World Models
Stuart Shanks*, Jonathan Embley-Riches*, Jianheng Liu*, Andromachi Maria Delfaki, Carlo Ciliberto, Dimitrios Kanoulas
Frontiers in Robotics and AI, 2025
05
OCMDP: Observation-Constrained Markov Decision Process
Taiyi Wang*, Jianheng Liu*, Bryan Lee, Zhihao Wu, Yu Wu
International Joint Conference on Neural Networks (IJCNN), 2025
06
Detect an Object At Once without Fine-tuning
Junyu Hao*, Jianheng Liu*, Yongjia Zhao, Zuofan Chen, Qi Sun, Jinlong Chen, Jianguo Wei, Minghao Yang
International Conference on Neural Information Processing (ICONIP), 2024
04 // Services
Conference Reviewer
CVPR 2026
