Hi! I am Wei-Cheng Tseng

I am a PhD student at University of Toronto advised by Prof. Florian Shkurti. My research interests encompass Robot Learning, 3D Vision, and Video Prediction Models. Previously, I worked with Prof. Phillip Isola on offline learning in multi-agent scenario.

I graduated with B.S. and M.S. from the Electrical Engineering Department at National Tsing Hua University, supervised by Prof. Min Sun.

[CV] [GitHub] [Twitter] [Google Scholar]

Experience

Oct 2024 - Present Nvidia
Research Intern
Jan 2024 - Present Vector Institute
Faculty Affiliate Researcher
Sep 2022 - Present RVLab @ UofT, Ph.D. student
Advisor: Prof. Florian Shkurti
Sep 2019 - 2022 VSLab @ NTHU, M.S. student
Advisor: Prof. Min Sun
July 2018 - Oct 2018 MediaTek, Internship

Selected Publications

Publication thumbnail
How Far are Action-Conditional Video Prediction Models from World Simulators? A Case Study in Evaluating Robot Manipulation Policies
Wei-Cheng Tseng, Jinwei Gu, Qinsheng Zhang, Hanzi Mao, Ming-Yu Liu, Florian Shkurti, Lin Yen-Chen
under review
Publication thumbnail
Cosmos World Foundation Model Platform for Physical AI
Nvidia et. al.
Arxiv 2025 Code PDF
Publication thumbnail
Gaussian Splatting Visual MPC for Granular Media Manipulation
Wei-Cheng Tseng, Ellina Zhang, Krishna Murthy Jatavallabhula, Florian Shkurti
ICRA 2025 Webiste PDF
Publication thumbnail
VMCML: Video and Music Matching via Cross-Modality Lifting
Yi-Shan Lee, Wei-Cheng Tseng, Fu-En Wang, Min Sun
CVPR Workshop 2024. PDF
Publication thumbnail
Offline Multi-Agent Reinforcement Learning with Knowledge Distillation
Wei-Cheng Tseng, Tsun-Hsuan Wang, Yen-Chen Lin, Phillip Isola
NeurIPS 2022. PDF
Publication thumbnail
Meta-CPR: Generalize to Unseen Large Number of Agent with Communication Pattern Recognition Module
Wei-Cheng Tseng, Da-Cheng Juan, Wei Wei, Min Sun
Arxiv 2022. PDF
Publication thumbnail
CLA-NeRF: Category-Level Articulated Neural Radiance Field
Wei-Cheng Tseng, Hung-Ju Liao, Yen-Chen Lin, Min Sun
ICRA 2022. Webiste PDF
Publication thumbnail
Toward Robust Long Range Policy Transfer
Wei-Cheng Tseng, Jin-Siang Lin, Yao-Min Feng, Min Sun
AAAI 2021. PDF
HAT: Hierarchical Alternative Training for Long Range Policy Transfer
Wei-Cheng Tseng, Jin-Siang Lin, Yao-Min Feng, Min Sun
ICML Workshop 2020. PDF
Disentangling Experimental Noise from Fluorescent Microscopy Images with Multiple Cell Type
Wei-Cheng Tseng, Cheng-Kuan Chen, Tayden Li, Min Sun.
NeurIPS Workshop 2019.
Leveraging Sequence Embedding and Convolutional Neural Network for Protein Function Prediction
Wei-Cheng Tseng, Po-Han Chi, Jia-Hua Wu, Min Sun.
NeurIPS Workshop 2018. PDF

Side Project

...
PyTorch-PCGrad

Reimplementation for Gradient Surgery for Multi-Task Learning in PyTorch. [code]

...
Multi-Agent Fromework on Unity

This repository provide code of mulit-agent framework on unity ml-agent. [code]

Honor

Aug 2021 NovaTek Scholarship
Awarded to students with outstanding research ability
Apr 2021 The Phi Tau Phi Scholastic Honor Society Honorary Membership
Awarded to students with outstanding research ability
June 2019 Dr. Mei Yi-Chi Memorial Prize
Highest honor for newly graduated students at NTHU
Dec 2018 Pan Wen Yan Foundation Scholarship
Mar 2017 The Zhu Shun Yi He Qin Scholarship
Mar 2017 Summer Oversea Experience Scholarship
2016, 2017, 2018, 2019 Academic Achievement Award

Community Service

Reviewer: ICML 2022, NeurIPS 2022, CVPR 2023, ICRA 2025, ICLR 2025, ICML 2025, NeurIPS 2025