Yisheng He

Yisheng He (何益升)

Yisheng He obtained his Ph.D. at the Hong Kong University of Science and Technology (HKUST), advised by Prof. Qifeng Chen, Prof. Long Quan, and Dr. Jian Sun.

Email / Google Scholar / GitHub / WeChat

Research

I'm interested in 3D computer vision, AIGC, robotics, few-shot learning, and self-supervised learning.

	LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioning Zhe Li, Weihao Yuan, Yisheng He, Lingteng Qiu, Shenhao Zhu, Xiaodong Gu, Weichao Shen, Yuan Dong, Zilong Dong, Laurence T. Yang Arxiv, 2024 project page / code
	Gaussian-Informed Continuum for Physical Property Identification and Simulation Junhao Cai, Yuji Yang, Weihao Yuan, Yisheng He, Zilong Dong, Liefeng Bo, Hui Cheng, Qifeng Chen NeurIPS, 2024 (Oral Presentation) project page / code
	MoGenTS: Motion Generation based on Spatial-Temporal Joint Modeling Weihao Yuan, Yisheng He*, Weichao Shen, Yuan Dong, Xiaodong Gu, Zilong Dong, Liefeng Bo, Qixing Huang NeurIPS, 2024* project page
	Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition Yisheng He, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, Qixing Huang ECCV, 2024 project page We enable high-fidelity, transferable, and intensity control for neural field editing.
	Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation Minglin Chen, Longguang Wang, Weihao Yuan, Yukun Wang, Zhe Sheng, Yisheng He, Zilong Dong, Liefeng Bo, Yulan Guo Arxiv, 2024 Our method synthesizes consistent 3D content with fine-grained sketch control.
	OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimation Junhao Cai, Yisheng He*, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, Qifeng Chen, IEEE Robotics and Automation Letters (RA-L), 2024* project page / code We introduce a new problem: open-vocabulary 9D object pose and size estimation, a new dataset: OO3D-9D, and a framework to tackle this challenging new problem.
	Towards Self-Supervised Category-Level Object Pose and Size Estimation Yisheng He, Haoqiang Fan, Haibin Huang, Qifeng Chen, Jian Sun Arxiv, 2022 project page / arXiv A self-supervised framework for category-level object pose and size estimation via differentiable shape deformation, registration, and rendering.
	FS6D: Few-Shot 6D Pose Estimation of Novel Objects Yisheng He, Yao Wang, Haoqiang Fan, Jian Sun, Qifeng Chen CVPR, 2022 project page / arXiv / data / code A new open-set few-shot 6D object pose estimation problem: estimating the 6D pose of an unknown object by a few support views without CAD models and extra training. A large-scale synthesis dataset for pre-training and benchmarks for future research.
	FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, Jian Sun CVPR, 2021 (Oral Presentation) project page / arXiv / code / video (youtube) / video (bilibili) A generic full flow bidirectional fusion framework for RGBD representation learning, applied to joint instance semantic segmentation and 3D keypoint-based 6D pose estimation.
	iShape: A First Step Towards Irregular Shape Instance Segmentation Lei Yang, Ziwei Yan, Yisheng He, Wei Sun, Zhenhang Huang, Haibin Huang, Haoqiang Fan arXiv, 2021 project page / arXiv / code / dataset A brand new dataset to promote the study of instance segmentation for objects with irregular shapes and an affinity-based algorithm to tackle it.
	PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation Yisheng He, Wei Sun, Haibin Huang, Jianran Liu, Haoqiang Fan, Jian Sun CVPR, 2020 project page / arXiv / code / video (youtube) / video (bilibili) The first deep learning 3D keypoint-based 6D pose estimation algorithm and an overall framework for joint instance semantic segmantation and 3D keypoint detection.