教师名录 当前所在位置:首页 > 师资队伍 > 教师名录

郭遥

助理教授,博士生导师

通讯地址: 转化医学大楼N220
电子邮件: yao.guo at sjtu.edu.cn

  • 个人简介

    本课题组常年招收对计算机视觉、康复与辅助机器人、社交机器人、人体行为与认知分析等领域感兴趣的本科生以及博士后,欢迎发送邮件联系。
    2023年入学的博士名额(暂无),硕士名额(已确定)。

    NEWS

    2022.08 Our paper "An Intelligent Nutritional Assessment System for Handheld Food Items via Weakly-Supervised Point Cloud Completion" is accepted by IEEE Transactions on Multimedia!
    2022.07 Our review paper "Detection and Assessment of Parkinson's Disease based on Gait Analysis: A Survey" is accepted by Frontiers in Aging Neuroscience!
    2022.07 Our paper "Tackling Long-Tailed Category Distribution Under Domain Shifts" is accepted by ECCV 2022! Congrats to Xiao Gu
    2022.06 Our paper "Ego+X: An Egocentric Vision System for Global 3D Human Pose Estimation and Social Interaction Characterization" is accepted by IROS 2022! Congrats to Yuxuan Liu!
    2022.06 Our collaboration paper “X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning” is accepted by CVPR 2022! Congrats to Prof Zhen Li's group [Deep Bit Lab]!
    2022.06 Our team achieves the 3rd place in the Action Anticipation Track of EPIC@CVPR22 ! Congrats to Xiao Gu!
    2022.05 Jianxin Yang presents his work at ICRA 2022.
    2022.05 Our paper "Medical Robotics: Opportunities in China" is published by Annual Review of Control, Robotics, and Autonomous Systems!
    2022.03 Our paper "Cross-Domain Self-Supervised Complete Geometric Representation Learning for Real-Scanned Point Cloud Based Pathological Gait Analysis! Congrats to Xiao Gu!
    2022.02 Our paper "Eye-tracking for Performance Evaluation and Workload Estimation in Space Telerobotic Training" is published by IEEE Transactions on Human-Machine Systems!
    2022.01 Our paper "PoseSDF: Simultaneous 3D Human Shape Reconstruction and Gait Pose Estimation Using Signed Distance Functions" is accepted by ICRA 2022! Congrats to Jianxin Yang!
    2022.01 Our collaboration paper "AcousNet: A Deep Learning based Approach to Dynamic 3D Holographic Acoustic Field Generation from Phased Transducer Array" is accepted by IEEE RA-L & ICRA 2022! Congrats to Prof Song Liu's group [AMNR Lab] !

  • 教育背景


    • 香港城市大学,机械与生物医学工程系,博士学位

    • 中山大学,信息科学与技术学院,硕士学位

    • 中山大学,信息科学与技术学院,学士学位

  • 工作经历


    • 2020至今 上海交通大学 生物医学工程学院/医疗机器人研究院,长聘教轨助理教授

    • 2018-2020 Imperial College London, The Hamlyn Centre for Robotic Surgery, Research Associate

    • 2017-2018 香港城市大学 机械与生物医学工程系,Research Assistant

  • 研究方向


    • 人体运动分析,人体姿态估计,人体形状重构,步态分析

    • 机器视觉,视觉SLAM,模式识别,机器学习,深度学习

    • 脑机接口,精神负荷检测,认知康复与辅助

    • 康复机器人, 社交机器人,人机交互

  • 代表性论文专著

    2022

    [29] Jianxin Yang, Yuxuan Liu, Xiao Gu, Guang-Zhong Yang, and Yao Guo*, "PoseSDF: Simultaneous 3D Human Shape Reconstruction and Gait Pose Estimation Using Signed Distance Functions", IEEE International Conference on Robotics and Automation (ICRA), Philadelphia, USA, pp. 1297-1303, May, 2022. (*Corresponding author) [Paper]


    Illustration of the training and inference phases of DeepSDF and our PoseSDF.

    Visualization of both shape reconstruction (DeepSDF v.s. PoseSDF) and pose estimation (V2V v.s. PoseSDF) results by directly taking real partial point cloud as input.

    [28] Yao Guo, Weidong Chen, Jie Zhao, and Guang-Zhong Yang*, "Medical Robotics: Opportunities in China", Annual Review of Control, Robotics, and Autonomous Systems (ARCRAS), vol. 5, no. 1, pp. 361-383, May, 2022. [Paper]

    Taxonomy of medical robotics.

    (a) Market sizes of medical robotics in the world and in China from 2017 to 2021. (b) Market distribution of different medical robots in China in 2019.

    [27] Yao Guo, Jianxin Yang, Yuxuan Liu, Xun Chen*, and Guang-Zhong Yang*, "Detection and Assessment of Parkinson's Disease based on Gait Analysis: A Survey", Frontiers in Aging Neuroscience, 14:916971, 2022, [Paper].

    Illustration of the pipeline for automatic recognition in PD based on Gait Data.

    [26] Yao Guo, Daniel Freer, Fani Deligianni, and Guang-Zhong Yang*, "Eye-tracking for Performance Evaluation and Workload Estimation in Space Telerobotic Training", IEEE Transactions on Human-Machine Systems (THMS), vol. 52, no. 1, pp. 1-11, February, 2022. [Paper]

    The left image demonstrates an overview of our O^3 simulator from a global view. The middle part shows the user interface observed by operators. The right part shows the controller and the control strategy.

    Relationship between the simulator-defined Final score and three eye-tracking features extracted from trial data.

    [25] Xiao Gu, Yao Guo, Guang-Zhong Yang*, and Benny Lo*, "Cross-Domain Self-Supervised Complete Geometric Representation Learning for Real-Scanned Point Cloud Based Pathological Gait Analysis", IEEE Journal of Biomedical and Health Informatics (J-BHI), vol. 26, no. 3, pp. 1034-1044, March, 2022. [Paper]

    Illustration of our proposed self-supervised learning framework.

    Visualizations of completed point sets (bottom) from real-scanned data (top).

    [24] Chengxi Zhong, Yuyu Jia, David C. Jeong, Yao Guo*, Song Liu*, "AcousNet: A Deep Learning based Approach to Dynamic 3D Holographic Acoustic Field Generation from Phased Transducer Array", IEEE Robotics and Automation Letters (RA-L), vol. 7, no. 2, pp. 666-673, April, 2022. [Paper] [Dataset]. (*Co-corresponding author)

    Schematic of the holographic acoustic field generated from phased transducer array with squared transducer element.

    [23] Zhihao Yuan†, Xu Yan†, Yinghong Liao,Yao Guo, Guanbin Li, Zhen Li*, and Shuguang Cui , "X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning", IEEE/CVF Conference of Computer Vision and Pattern Recognition (CVPR), June, 2022, Accepted. [Paper]

    [22] Frank Lo, Yao Guo*, Yingnan Sun, Jianing Qiu, Benny Lo, "An Intelligent Nutritional Assessment System for Handheld Food Items via Weakly-Supervised Point Cloud Completion", IEEE Transactions on Multimedia (TMM), , 2022, Accepted. (*Corresponding author)

    [21] Xiao Gu, Yao Guo, Zeju Li, Jianing Qiu, Qi Dou, Yuxuan Liu, Benny Lo*, and Guang-Zhong Yang*, "Tackling Long-Tailed Category Distribution Under Domain Shifts", European Conference on Computer Vision (ECCV), July, 2022, [Paper] [Code], Accepted.

    [20] Yuxuan Liu, Jianxin Yang, Xiao Gu, Yao Guo*, and Guang-Zhong Yang*, "Ego+X: An Egocentric Vision System for Global 3D Human Pose Estimation and Social Interaction Characterization", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), July, 2022, Accepted. (*Co-corresponding author)

    [19] Yuxuan Liu, Jianxin Yang, Xiao Gu, Yijun Chen, Yao Guo*, and Guang-Zhong Yang*, "EgoFish3D: Egocentric 3D Pose Estimation from a Fisheye Camera via Self-Supervised Learning", Submitted to IEEE Transactions on Multimedia (TMM), 2022. [Paper]. (*Co-corresponding author)

    [18] Xiao Gu, Jianxin Yang, Hanxiao Zhang, Jianing Qiu, Frank Po Wen Lo, Yao Guo, Guang-Zhong Yang, and Benny Lo, "Occlusion-Invariant Rotation-Equivariant Semi-Supervised Depth Based Cross-View Gait Pose Estimation", Submitted to IEEE Transactions on Image Processing (TIP), 2022. [Paper].

    2021

    [17] Yao Guo, Xiao Gu, and Guang-Zhong Yang*, "MCDCD: Multi-Source Unsupervised Domain Adaptation for Abnormal Human Gait Detection", IEEE Journal of Biomedical and Health Informatics (J-BHI), vol. 25, no. 10, pp. 4017-4028, October, 2021. [Paper]

    An overview of the proposed MCDCD framework for abnormal gait recognition.

    t-SNE visualization of the (a) Mocap & (b) EMG feature distributions befor and after unsupervised domain adaptation.

    [16] Frank Po Wen Lo, Yao Guo*, Yingnan Sun, Jianing Qiu, and Benny Ping Lai Lo, "Deep3DRanker: A Novel Framework for Learning to Rank 3D Models with Self-Attention in Robotic Vision", IEEE International Conference on Robotics and Automation (ICRA), Xi'an, China, 30 May-05 June, pp. 4341-4347, 2021. (*Corresponding author) [Paper]

    Flowchart of the proposed Deep3DRanker.

    The model architecture of the proposed Deep3DRanker.

    [15] Xiao Gu, Yao Guo, Fani Deligianni, Benny Lo, Guang-Zhong Yang*, “Cross-Subject and Cross-Modal Transfer for Generalized Abnormal Gait Pattern Recognition,” IEEE Transactions on Neural Networks and Learning Systems (TNNLS), vol. 32, no. 2, pp. 546-560, February, 2021. [Paper]

    Illustration of the cross-subject and cross-modal transfer framework in abnormal gait recognition.

    Illustration of cross-modal cross-subject transfer model.

    [14] Yao Guo, Xiao Gu, and Guang-Zhong Yang*, “Human–Robot Interaction for Rehabilitation Robotics.” Digitalization in Healthcare: Implementing Innovation and Artificial Intelligence, Springer, pp. 269-295, 2021. [Chapter]

    Bidirectional HRI in upper-limb prosthetic control, which includes forward prosthetic control and sensory feedback.

    Requirements of HRI for active, natural, and intelligent robot-assisted stroke rehabilitation.

    2020

    [13] Xiao-Yun Zhou*, Yao Guo, Mali Shen, Guang-Zhong Yang, “Application of Artificial Intelligence in surgery,” Frontiers of Medicine, vol. 14, pp. 417-430, July, 2020. [Paper]

    [12] Xiao Gu, Yao Guo, Fani Deligianni, Guang-Zhong Yang*, “Coupled real-synthetic domain adaptation for real-world deep depth enhancement,” IEEE Transactions on Image Processing (TIP), vol. 29, pp. 6343-6356, April, 2020. [Paper]


    Overview of the proposed depth enhancement framework..

    Qualitative results of cross-dataset performance on real-world data.

    Before 2020

    [11] Yao Guo†, Fani Deligianni†, Guang-Zhong Yang*, “From Emotions to Mood Disorders: A Survey on Gait Analysis Methodology,” IEEE Journal of Biomedical and Health Informatics (J-BHI), vol. 23, no. 6, pp. 2302-2316, November, 2019. (†: equal contribution), [Paper]

    Gait capture systems are mapped in a two-dimensional space from lab-based to home-based environment and from wearable to vision-based.

    Demonstration of four discriminative gait parameters commonly used in emotion detection (neutral, happy, sad, anger and fear).

    [10] Yao Guo, Fani Deligianni, Xiao Gu, Guang-Zhong Yang*, “3D Canonical Pose Estimation and Abnormal Gait Recognition with a Single RGB-D Camera,” IEEE Robotics and Automation Letters (RA-L) & IROS 2019, vol. 4, no. 4, pp. 3617-3624, October, 2019. [Paper]
    centered image
    Overview of the proposed mobile 3D canonical gait analysis system.
    centered image
    Information fusion for human lower limb pose representation and 3D gait analysis in the canonical coordinate system.

    [9] Ya-Yen Tsai, Yao Guo, and Guang-Zhong Yang*, “Unsupervised Task Segmentation Approach for Bimanual Surgical Tasks using Spatiotemporal and Variance Properties,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, pp. 7940-7946, 2019.

    [8] Dandan Zhang, Yao Guo, Junhong Chen, Jindong Liu, and Guang-Zhong Yang*, ``A Handheld Master Controller for Robot-Assisted Microsurgery,'' IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, pp. 394-400, 2019.

    [7] Yao Guo, You-Fu Li*, Zhanpeng Shao, “RRV: A spatiotemporal descriptor for rigid body motion recognition,” IEEE Transactions on Cybernetics (TCyber), vol. 48, no. 5, pp. 1513-1525, May, 2018. [Paper]

    6-D representation of a rigid body motion trajectory.

    [6] Yao Guo, You-Fu Li*, Zhanpeng Shao, “DSRF: A Flexible Trajectory Descriptor for Articulated Human Action Recognition,” Pattern Recognition, vol. 76, April, pp. 137-148, April, 2018. [Paper]

    Pipeline of the proposed skeletal representation.

    [5] Yao Guo, You-Fu Li*, Zhanpeng Shao, “On multi-scale self-similarities description for effective 3D/6D motion trajectory recognition,” IEEE Transactions on Industrial Informatics (TII), vol. 13, no. 6, pp. 3017-3026, December, 2017. [Paper]

    [4] Yao Guo, You-Fu Li*, and Zhanpeng Shao, “MSM-HOG: A flexible trajectory descriptor for rigid body motion recognition,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, Canada, pp. 4298-4303, 2017.

    [3] Yao Guo, You-Fu Li*, and Zhanpeng Shao, “DSRF: A Flexible Descriptor for Effective Rigid Body Motion Trajectory Recognition,” IEEE International Conference on Mechatronics and Automation (ICMA), Harbin, China, pp. 1673-1678, 2016. (Best Conference Paper Award)

    [2] Yao Guo, Kaide Huang, Nanyong Jiang, Xuemei Guo, Guoli Wang*, “An Exponential-Rayleigh model for RSS-based device-free localization and tracking,” IEEE Transactions on Mobile Computing (TMC), vol. 14, no. 3, pp. 484-494, March, 2015. [Paper]

    [1] Yao Guo, Kaide Huang, Nanyong Jiang, Xuemei Guo, and Guoli Wang*, “An Exponential-Rayleigh signal strength model for device-free localization and tracking with wireless networks,” International Conference on Intelligent Control and Information Processing (ICICIP), Beijing, China, 2013, pp. 108-113.

  • 教学工作

    2021秋 GE6001 学术写作、规范与伦理
    2022春 GE6012 学术报告与研讨会
    2022秋 BME3307 自动控制原理

  • 学术兼职

    Guest Editor of Special Issue 'Sensor-based pattern recognition and signal processing' of MDPI sensors. [Call for Paper] (Submission deadline: 31 Aug, 2022)

友情链接
沪交ICP备20190057 版权所有 上海交通大学医疗机器人研究院   流量统计
医疗机器人研究院