Kun He

何坤 • Researcher at Meta Reality Labs • FirstnameLastname @ meta.com

kun16.jpg

I am a research scientist at Meta Reality Labs, working on the future of communication and interactions in AR/VR, using computer vision and machine learning techniques. Here’s my CV.

My current research interests include: human body/hand pose estimation and tracking, domain adaptation, and active learning.

I graduated from Boston University in 2018 with PhD and MSc degrees in computer science. My advisor was Professor Stan Sclaroff. During grad school, I did research internships at Disney Research and Honda Research Institute, and I was a visiting student at Brown University. I hold a Bachelor’s degree in computer science from Zhejiang University, China.

news

Jul 04, 2024 Paper accepted at ECCV 2024 (with Zicong Fan, Takehiko Ohkawa, Linlin Yang et al): Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects
Jun 18, 2024 Assembly101 paper received the EgoVis 2022/2023 Distinguished Paper Award. Honored to be part of the team.
May 01, 2024 I am co-organizing the HANDS workshop at ECCV 2024.
Jun 25, 2023 AssemblyHands dataset will be featured in the 7th HANDS workshop at ICCV 2023: Task 1 - Egocentric 3D Hand Pose Estimation.
Feb 28, 2023 Paper accepted to CVPR 2023 (with Takehiko Ohkawa et al): AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation.

publications

conference papers

  1. AssemblyHands.png
    AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation
    Takehiko Ohkawa, Kun He, Fadime Sener, Tomáš Hodaň, Luan Tran, and Cem Keskin
    In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , Jun 2023
    Website
  2. ALpose.png
    Rethinking the Data Annotation Process for Multi-view 3D Pose Estimation with Active Learning and Self-Training
    Qi Feng, Kun He, He Wen, Cem Keskin, and Yuting Ye
    In Proc. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , Jan 2023
    PDF Code
  3. Assembly101.png
    Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities
    Fadime Sener, Dibyadip Chatterjee, Daniel Shelepov, Kun He, Dipika Singhania, Robert Wang, and Angela Yao
    In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , Jun 2022
    PDF Website
  4. fastap.png
    Deep Metric Learning to Rank
    Kun He*, Fatih Çakir*, Xide Xia, Brian Kulis, and Stan Sclaroff
    In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , Jun 2019
    PDF Code Poster
  5. gmm.png
    Generalized Majorization-Minimization
    Sobhan Naderi Parizi, Kun He, Reza Aghajani, Stan Sclaroff, and Pedro Felzenszwalb
    In Proc. International Conference on Machine Learning (ICML) , Jun 2019
    PDF
  6. text2clip.png
    Multilevel Language and Vision Integration for Text-to-Clip Retrieval
    Huijuan Xu, Kun He, Bryan A. Plummer, Leonid Sigal, Stan Sclaroff, and Kate Saenko
    In Proc. The Thirty-Third AAAI Conference on Artificial Intelligence , Jun 2019
    PDF Code
  7. HBMP.png
    Hashing with Binary Matrix Pursuit
    Fatih Çakir, Kun He, and Stan Sclaroff
    In Proc. European Conference on Computer Vision (ECCV) , Jun 2018
    PDF Code
  8. DOAP.png
    Local Descriptors Optimized for Average Precision
    Kun He, Yan Lu, and Stan Sclaroff
    In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , Jun 2018
    PDF Poster Website
  9. TALR.png
    Hashing as Tie-Aware Learning to Rank
    Kun He, Fatih Çakir, Sarah Adel Bargal, and Stan Sclaroff
    In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , Jun 2018
    PDF Code Poster
  10. mihash.png
    MIHash: Online Hashing With Mutual Information
    Kun He*, Fatih Çakir*, Sarah Adel Bargal, and Stan Sclaroff
    In Proc. IEEE International Conference on Computer Vision (ICCV) , Jun 2017
    PDF Code Poster
  11. eccv2014.png
    Parameterizing Object Detectors in the Continuous Pose Space
    Kun He, Leonid Sigal, and Stan Sclaroff
    In Proc. European Conference on Computer Vision (ECCV) , Jun 2014
    PDF Supp Poster
  12. cvpr2012.png
    Scale Resilient, Rotation Invariant Articulated Object Matching
    Hao Jiang, Tai-Peng Tian, Kun He, and Stan Sclaroff
    In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , Jun 2012
    PDF

journal papers

  1. mihash_tpami.png
    Hashing with Mutual Information
    Kun He*, Fatih Çakir*, Sarah Adel Bargal, and Stan Sclaroff
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019
    PDF Code
  2. ambiguous_truth.jpg
    Predicting Foreground Object Ambiguity And Efficiently Crowdsourcing the Segmentation(s)
    Danna Gurari, Kun He, Bo Xiong, Jianming Zhang, Mehrnoosh Sameki, Suyog Dutt Jain, Stan Sclaroff, Margrit Betke, and Kristen Grauman
    International Journal of Computer Vision (IJCV), 2018
    PDF

theses

  1. BUseal.jpg
    Learning Deep Embeddings by Learning to Rank
    Kun He
    Ph.D. Dissertation, Boston University, 2018
    PDF
  2. sfd.png
    Stochastic Functional Descent for Learning Support Vector Machines
    Kun He
    M.Sc. Thesis, Boston University, 2013
    PDF