Yisheng He

Yisheng He (何益升)

Yisheng He is a forth year Ph.D. student at the Hong Kong University of Science and Technology (HKUST), advised by Prof. Qifeng Chen, Prof. Long Quan, and Dr. Jian Sun.

Email / Google Scholar / GitHub / WeChat

Research

I'm interested in 3D computer vision, RGBD representation learning (sensor fusion), robotics, few-shot learning and self-supervised learning. Downstream applications includes autonomous driving, AR/VR, robotic manipulation, etc.

	Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition Yisheng He, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, Qixing Huang ECCV, 2024 project page We enable high-fidelity, transferable, and intensity control for neural field editing.
	Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation Minglin Chen, Longguang Wang, Weihao Yuan, Yukun Wang, Zhe Sheng, Yisheng He, Zilong Dong, Liefeng Bo, Yulan Guo Arxiv, 2024 Our method synthesizes 3D consistent contents with fine-grained sketch control.
	OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimation Junhao Cai, Yisheng He*, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, Qifeng Chen, IEEE Robotics and Automation Letters (RA-L), 2024* project page We introduce a new problem: open-vocabulary 9D object pose and size estimation, a new dataset: OO3D-9D, and a framework to tackle this challenging new problem.
	Towards Self-Supervised Category-Level Object Pose and Size Estimation Yisheng He, Haoqiang Fan, Haibin Huang, Qifeng Chen, Jian Sun Arxiv, 2022 project page / arXiv A self-supervised framework for category-level object pose and size estimation via differentiable shape deformation, registration, and rendering.
	FS6D: Few-Shot 6D Pose Estimation of Novel Objects Yisheng He, Yao Wang, Haoqiang Fan, Jian Sun, Qifeng Chen CVPR, 2022 project page / arXiv / data / code A new open-set few-shot 6D object pose estimation problem: estimating the 6D pose of an unknown object by a few support views without CAD models and extra training. A large-scale synthesis dataset for pre-training and benchmarks for future research.
	FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, Jian Sun CVPR, 2021 (Oral Presentation) project page / arXiv / code / video (youtube) / video (bilibili) A generic full flow bidirectional fusion framework for RGBD representation learning, applied to joint instance semantic segmentation and 3D keypoint-based 6D pose estimation.
	iShape: A First Step Towards Irregular Shape Instance Segmentation Lei Yang, Ziwei Yan, Yisheng He, Wei Sun, Zhenhang Huang, Haibin Huang, Haoqiang Fan arXiv, 2021 project page / arXiv / code / dataset A brand new dataset to promote the study of instance segmentation for objects with irregular shapes and an affinity-based algorithm to tackle it.
	PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation Yisheng He, Wei Sun, Haibin Huang, Jianran Liu, Haoqiang Fan, Jian Sun CVPR, 2020 project page / arXiv / code / video (youtube) / video (bilibili) The first deep learning 3D keypoint-based 6D pose estimation algorithm and an overall framework for joint instance semantic segmantation and 3D keypoint detection.