人机交互、人工智能、混合现实、具身智能

招收对人机交互、人工智能、混合现实、具身智能感兴趣、动手能力强、有钻研精神的全日制博士、硕士研究生。

​

081203-计算机应用技术

人机交互,人工智能,混合现实,具身智能

2019-12--2021-04   剑桥大学   访问学者
2014-09--2018-01   中国科学院软件研究所   博士学位
2009-09--2011-07   北京交通大学   硕士学位
2004-09--2008-07   北京航空航天大学   学士学位

2021-09~现在, 中国科学院软件研究所, 副研究员
2018-04~2021-08,中国科学院软件研究所, 助理研究员
2013-09~2018-03,中国科学院软件研究所, 科研助理
2012-09~2013-08,广西民族大学, 助教
2011-09~2012-08,广西大学, 助教

2023-08-01-今,International Journal of Gaming and Computer-Mediated Simulations (IJGCMS) 编委, 编委
2020-10-01-今,中国计算机学会 人机交互专委会 执行委员, 执行委员
2020-08-01-今,中国图形图像学会 人机交互专委会 委员, 委员
2020-08-01-今,中国人工智能学会 情感计算专委会 委员, 委员
2019-12-31-2022-11-30,ACM CHI 程序委员会委员, 程序委员会委员

（1） 2020年度ACM中国分会SIGCHI学术新星奖, 其他, 2020
（2） 国际人机交互顶级会议ACM CHI 2020最佳论文提名奖-Modeling the Endpoint Uncertainty in Crossing based Moving Target Selection, 其他, 2020
（3） 国际人机交互顶级会议ACM CHI 2020最佳论文提名奖-Get a Grip Evaluating Grip Gestures for VR Input using a Lightweight Pen, 其他, 2020
（4） 际人机交互顶级会议ACM CHI 2019最佳论文提名奖-SmartEye Assisting Instant Photo Taking, 其他, 2019

[1]   一种基于用户表现模型矫正的移动目标选择方法及系统, 发明, 2018105586224, 黄进,李念龙,田丰,王宏安, 中国科学院软件研究所

[2]   一种日常环境中的目标用户步态识别系统及方法, 发明, 2019100216329, 田丰,黄进,周立新,朱以诚,马帅,王宏安, 中国科学院软件研究所

[3]   一种基于交互时序信息的草图手势识别方法, 发明, 2019102219143, 田丰,李翔,黄进,张宗琦,王宏安,戴国忠, 中国科学院软件研究所

[4]   一种基于人工势能场的目标选择方法及电子装置, 发明, 2020105981767, 黄进,张浩,田丰,王宏安, 中国科学院软件研究所

[5]   基于数位笔的画钟测试检测方法及系统, 发明, 2017101005307, 田丰,黄进,王宏安, 中国科学院软件研究所

[6]   一种基于笔和语音的协同任务神经系统疾病辅助诊断系统, 发明, 2018105761079, 李洋,黄进,田丰,王宏安, 中国科学院软件研究所

[7]   一种基于运动趋势信息的三维环境下辅助目标选择方法及系统, 发明, 2020106088083, 田丰,李念龙,黄进,王宏安, 中国科学院软件研究所

[8]   基于通用绘图任务的触控交互运动用户特征提取方法和辅助疾病检测系统, 发明, 2018115918974, 田丰,黄进,朱以诚,翟菲菲,王宏安, 中国科学院软件研究所

[1]   Yang Li, Juan Liu, Jin Huang(*), Yang Zhang, Xiaolan Peng, Yulong Bian, Feng Tian. Evaluating the effects of user motion and viewing mode on target selection in augmented reality. International Journal of Human-Computer Studies(IJHCS),Volume 191,2024,103327,ISSN 1071-5819,

[2]   Min Zhou, Xiaolan Peng*, Binjie Liu, Alena Denisova, Soumya C. Barathi, Zhuying Li, Xurong Xie, Jin Huang, and Feng Tian. 2025. Emotionally Challenging Games Can Satisfy Older Adults' Psychological Needs: From Empirical Study to Design Guidelines. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25). Association for Computing Machinery, New York, NY, USA, Article 290, 1–19.

[3]   Tianren Luo, Fenglin Lu, Jiafu Lv, Xiaohui Tan, Chang Liu, Fangzhi Yan, Jin Huang, Chun Yu, Teng Han, and Feng Tian. 2024. Exploring Experience Gaps Between Active and Passive Users During Multi-user Locomotion in VR. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 682, 1–19.

[4]   康文惠，黄进(*)，仝青山，付强，田丰，戴国忠. HchMER: 一种混合人机智能的手写数学表达式识别方法[J]. 软件学报，2024.

[5]   Wenhui Kang, Jin Huang(*), Qingshan Tong, Qiang Fu, Feng Tian, Guozhong Dai. MathAssist: A Handwritten Mathematics Expression Inputs Method with Autocomplete. In Proceedings of the 29th International Conference on Intelligent User Interfaces (ACM IUI '24). ACM, New York, NY, USA.

[6]   彭晓兰，黄进(*)，田丰. 情感挑战研究进展及其在元宇宙中的应用前景，中国图象图形学报，2024

[7]   盖鑫, 黄进(*), 王丹琳, 刘杰(*), 田丰, 戴国忠. 基于结构理解的手绘草图表格识别[J]. 计算机辅助设计与图形学学报.

[8]   Liuping Wang, Hongxin Li, Tong Wu, Fan Yang, Yang Yang, Jin Huang(*), and Feng Tian. Extrovert Increases Consensus? Exploring the Effects of Conversational Agent Personality for Group Decision Support. In Proceedings of the Eleventh International Symposium of Chinese CHI (CHCHI '23). Association for Computing Machinery, New York, NY, USA, 127–138.

[9]   Xiaolan Peng, Xurong Xie, Jin Huang, Chutian Jiang, Haonian Wang, Alena Denisova, Hui Chen, Feng Tian(*), Hongan Wang. ChallengeDetect: Investigating the Potential of Detecting In-Game Challenge Experience from Physiological Measures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’23), ACM CHI, April, 2023.

[10]  Hao Zhang, Jin Huang(*), Huawei Tu, Feng Tian. Shape-Adaptive Ternary-Gaussian Model: Modeling Pointing Uncertainty for Moving Targets of Arbitrary Shapes. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23) April 2023

[11]  Hao Zhang, Jin Huang(*), Huawei Tu, Feng Tian, Guozhong Dai, Hongan Wang. A unified user behavior model for trajectory-based tasks with different types of path constraints. Science China Information Sciences (SCIS) volume 66, Article number: 204101, 2023

[12]  Xiaolan Peng, Chenyu Meng, Xurong Xie, Jin Huang, Hui Chen(*), Hongan Wang. Detecting challenge from physiological signals: A primary study with a typical game scenario. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA’22), 2022, 1-7.

[13]  李洋, 康文惠, 黄进(*), 袁晓芳, 陈雪锦, 于茜, 武汇岳, 田丰, 戴国忠. 基于笔式交互的人机混合CAD概念设计[J]. 计算机集成制造系统，2022, 28(7):2050-2063.

[14]  Juan Liu, Yulong Bian(*), Yuting Xi, Yawen Zheng, Jin Huang, Wei Gai, Chenglei Yang(*), Xiangxu Meng. Evaluating the Role of Mixed Reality in Cognitive Training of Children with ASD: Evidence from A Mixed Reality Aquarium. International Journal of Humanities and Cultural Studies (IJHCS). 2022

[15]  Jin Huang, John Dudley, Stephen Uzor, Dong Wu, Per Ola Kristensson, Feng Tian(*). Understanding User Performance of Acquiring Targets with Motion-in-Depth in Virtual Reality. International Journal of Human-Computer Studies (IJHCS), 2022

[16]  Haonan Xu, Fei Lyu(*), Jin Huang, Huawei Tu. Applying Sonification to Sketching in the Air with Mobile AR Devices. IEEE Transactions on Human-Machine Systems (THMS). 2022

[17]  Fei Lyu(*), Huijing Li, Qiang Fu, Yujie Liu, Jin Huang, Zhigang Deng. Effects of Spatial Constraints and Ages on Children's Upper Limb Performance in Mid-air Gesture Interaction. Int J of Human-Computer Studies (IJHCS), 2022

[18]  Fei Lyu(*), Yujie Liu, Jin Huang, ZhaoLin Zhang. LotusMenu: A 3D Menu using Wrist and Elbow Rotation Inspired by Chinese Traditional Symbol. Science China Information Sciences (SCIS), Volume 64, Article number: 204101.

[19]  Yawen Zheng, Jin Huang(*), Juan Liu, Chenglei Yang, Feng Tian. A Scenario Adaptive Model for Predicting Error Rates in Moving Target Selection. In Proceedings of the 23nd International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '21:), 2021

[20]  康文惠，黄进(*)，田丰，范向民，刘杰，戴国忠. 人在回路的在线手写数学公式识别方法.计算机辅助设计与图形学学报,2021

[21]  Quan Wang(#), Ning Su(#), Jin Huang, Xinyu Liang, Jing Yuan, Ming Yao, Li-Xin Zhou, Zheng-Yu Jin, Shu-Yang Zhang, Li-Ying Cui, Gaolang Gong, Feng Tian, Yi-Cheng Zhu,Jun Ni. White matter but not gray matter volume is associated with cognition in community-dwelling Chinese populations. Journal of Alzheimer's Disease, 2021, 84(1): 367-375.

[22]  Ning Su, Jin Huang, Zi-Ang Pan, Jing Yuan, Jun Ni, Li-Xin Zhou, Ming Yao, Li-Ying Cui, Zheng-Yu Jin, Shu-Yang Zhang, Feng Tian, Yi-Cheng Zhu. Application Of Digital Cognition And Pen-based SketchingTasks In A Chinese Population-Based Cohort. AAN 2021 posters section.

[23]  苏宁，刘杰，黄进，张江霞，韩菲，倪俊，田丰，朱以诚(*). 脑小血管病冻结步态患者的临床及影像特征分析. 中华老年心脑血管病杂志. 2021

[24]  李洋, 汪柳萍, 黄进(*), 范向民, 田丰. 人机交互技术在神经系统疾病辅助诊断中的应用:现状与前景[J]. 协和医学杂志, 2021,12(5):608-613.

[25]  黄进，张浩，田丰(*)，面向动态交互场景的计算模型. 图学学报. 2021

[26]  Huawei Tu, Jin Huang(*), Hai-Ning Liang, Richard Skarbez, Feng Tian, Henry Been-Lirn Duh. Distractor Effects on Crossing-Based Interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21) April 2021, pp 1–13

[27]  Xiaolan Peng(#), Jin Huang(#), Alena Denisova, Hui Chen*, Feng Tian, Hongan Wang*. A Palette of Deepened Emotions: Exploring Emotional Challenge in Virtual Reality Games. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), April 2020, pp 1–12

[28] Ziyue Zhang, Jin Huang(*), Feng Tian. Modeling the Uncertainty in Pointing of Moving Targets with Arbitrary Shapes. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20) April 2020 Pages 1–7

[29]  Nianlong Li, Teng Han(*), Feng Tian, Jin Huang, Minghui Sun, Pourang Irani, Jason Alexander. Get a Grip: Evaluating Grip Gestures for VR Input using a Lightweight Pen. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), April 2020, pp 1–12

[30]  Jin Huang, Xiaolan Peng(*), Rui Chen, Shengcai Duan, Feng Tian, Hongan Wang. Negative Emotion, Positive Performance? A Glimpse into Emotional Influences on Moving Target Selection. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20), April 2020, pp 1–8

[31]  Jin Huang, Feng Tian(*), Xiangmin Fan, Huawei Tu, Hao Zhang, Xiaolan Peng, Hongan Wang. Modeling the Endpoint Uncertainty in Crossing-based Moving Target Selection. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20), April 2020, pp 1–12

[32]  Shuai Ma, Zijun Wei, Feng Tian(*), Xiangmin Fan, Jianming Zhang, Xiaohui Shen, Zhe Lin, Jin Huang, Radomir Mech, Dimitris Samaras, HonganWang. SmartEye: Assisting Instant Photo Taking via Integrating User Preference with Deep View Proposal Network. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '19), May 4–9, 2019, Glasgow, Scotland UK.

[33]  Yang LI, Jin HUANG(*), Feng TIAN, Hong-An WANG, Guo-Zhong DAI. Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware, 2019, 1(1): 84-112

[34]  Yang LI, Dong WU, Jin HUANG(*), Feng TIAN, Hong'an WANG, Guozhong DAI. Influence of multi-modality on moving target selection in virtual reality. Virtual Reality & Intelligent Hardware, 2019, 1(3): 303-315

[35]  Xiaolan Peng, Jin Huang(*), Linghan Li, Chen Gao, Hui Chen, Feng Tian, HonganWang. Beyond Horror and Fear: Exploring Player Experience Invoked by Emotional Challenge in VR Games. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computin Systems (CHI EA '19), Paper No. LBW1949.

[36]  李翔, 黄进, 田丰(*), 刘杰, 王宏安, 戴国忠. 现代交互技术下的Story-Telling方法综述. 计算机辅助设计与图形学学报. 2019, 31(3): 349-363.

[37]  仝青山,张宗琦,黄进,田丰(*),刘杰,戴国忠.基于混合输入的场景设计工具.软件学报,2019,30(Suppl.(2)):48−61

[38]  仝青山, 张宗琦, 黄进, 田丰(*), 刘杰, 戴国忠. 基于混合输入的场景设计工具. 2019年中国人机交互学术会议

[39]  李念龙, 黄进, 田丰(*), 戴国忠, 王宏安. ICOMDT：一个面向动态任务的交互计算模型. 软件学报. 2019

[40]  Jin Huang, Feng Tian(*), Nianlong Li, Xiangmin Fan. Modeling the Uncertainty in 2D Moving Target Selection. In Proceedings of the 32th annual ACM symposium on User interface software and technology (UIST '19). New Orleans, LA, USA, October 2019, Pages 1031–1043

[41]  Jin Huang(*), Byungjoo Lee. Modeling Error Rates in Spatiotemporal Moving Target Selection. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computin Systems (CHI EA '19), Paper No. LBW1921.

[42]  Hao Zhang, Jin Huang(*), Feng Tian. Trajectory Prediction Model for Crossing-Based Target Selection. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computin Systems (CHI EA '19), Paper No. LBW2089.

[43]  Hao ZHANG, Jin HUANG(*), Feng TIAN, Guozhong DAI, Hongan WANG. Trajectory prediction model for crossing-based target selection. Virtual Reality & Intelligent Hardware, 2019, 1(3): 330-340

[44]  "Wei Sun, Jin Huang, Nianlong Li, Xiangmin Fan, Feng Tian(*), Guozhong Dai, Hongan Wang. BCI Assisted Dynamic Target Selection Technique. Journal of Software, 2018, 29(Suppl.(2)): 108–119. (In Chinese)

[45]  (孙伟, 黄进, 李念龙, 范向民, 田丰(*), 戴国忠, 王宏安. 脑机接口辅助的动态目标选择技术. 软件学报. 2018, 29 (Suppl.(2)): 108–119)"

[46]  Nianlong Li, Feng Tian(*), Jin Huang, Xiangmin Fan, Hongan Wang. 2D-BayesPointer: An Implicit Moving Target Selection Technique Enabled by Human Performance Modeling. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18), Paper No. LBW125

[47]  Liuping Wang, Xiangmin Fan(*), Feng Tian, Lingjia Deng, Shuai Ma, Jin Huang, Hongan Wang. mirrorU: Scaffolding Emotional Reflection via In-Situ Assessment and Interactive Feedback. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18), Paper No. LBW547

[48]  范俊君, 黄进, 刘杰, 田丰(*), 王宏安, 戴国忠. 基于肌肉感知的手势交互模型. 软件学报, 2018, 29(2): 64–76.

[49]  Jing Gao, Feng Tian(*), Junjun Fan, Dakuo Wang, Xiangmin Fan, Yicheng Zhu, Shuai Ma, Jin Huang, Hongan Wang. Implicit Detection of Motor Impairment in Parkinson's Disease from Everyday Smartphone Interactions. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computin Systems (CHI EA '18), Paper No. LBW043

[50]  Jin Huang, Xiaolan Peng, Feng Tian(*), Hongan Wang, Guozhong Dai. Modeling a Target-selection Motion by Leveraging an Optimal Feedback Control Mechanism. Science China Information Sciences (SCIS), April 2018, 61:044101.

[51]  Jin Huang, Feng Tian(*), Xiangmin Fan, Xiaolong(Luke) Zhang, Shumin Zhai. Understanding the Uncertainty in 1D Unidirectional Moving Target Selection. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '18), Montreal QC, Canada — April 21 - 26, 2018, Paper No. 237.

[52]  Huaiyi Zhao, Jie Liu*, Jiahao Wu, Kaiyu Yao, and Jin Huang. Watch-Learning: Using the Smartwatch for Secondary Language Vocabulary Learning. In Proceedings of the Sixth International Symposium of Chinese CHI (ChineseCHI '18). ACM, New York, NY, USA, 108-111.

[53]  李洋, 黄进, 田丰(*), 韩冬奇, 范俊君, 陈辉, 彭晓兰, 戴国忠, 王宏安.云端融合的神经系统疾病多通道辅助诊断研究.中国科学:信息科学,2017,47(09):1164-1182

[54]  刘杰, 黄进, 田丰(*), 胡伟平, 戴国忠, 王宏安. 连续交互空间下的混合手势交互模型. 软件学报, 2017, 28(8): 2080-2095

[55]  黄进, 陈毅能, 刘杰, 田丰(*), 戴国忠, 王宏安. 移动环境下神经功能评价多通道交互模型. 2016年中国人机交互学术会议

[56]  Yineng Chen, Xiaojun Su, Feng Tian(*), Jin Huang, Xiaolong(Luke) Zhang, Guozhong Dai, Hongan Wang. Pactolus: A Method for Mid-Air Gesture Segmentation within EMG. Extended Abstracts of the 2016 CHI Conference on Human Factors in Computing Systems (CHI EA '16), 2016, Pages 1760-1765

[57]  黄进, 陈毅能, 刘杰, 田丰(*), 戴国忠, 王宏安. 移动环境下神经功能评价多通道交互模型. 软件学报, 2016, 27: 156-171

[58]  黄进, 韩冬奇, 陈毅能, 田丰(*), 王宏安, 戴国忠. 混合现实中的人机交互综述. 计算机辅助设计与图形学学报, 2016, 28(6): 869-880

[59]  刘杰, 黄进, 韩冬奇, 田丰(*), 戴国忠, 王宏安. 模板匹配的三维手势识别算法. 计算机辅助设计与图形学学报, 2016, 28(8): 1365-1372

[60]  凌子燕(*), 黄进. 基于RBF神经网络的城市森林碳储量遥感建模与动态变化分析——以南京市为例. 林业资源管理, 2013, 4: 120-125

[61]  Huang Jin(*), Wei Wu, Ziyan Ling. Multi-agent Pathfinding System Implemented on XNA. In Proceedings of 4th International Conference on Computational Intelligence and Communication Networks, CICN 2012, 651-655.

​ [1] 黄进, 田丰. 第七章：增强现实中的人机交互. 增强现实：原理、算法和应用. 科学出版社

（ 1 ） 人机增强智能计算平台, 负责人, 研究所自主部署, 2024-06--2026-05
（ 2 ） 面向人机物三元空间复杂运动叠加的人机交互理论与技术, 参与, 国家任务, 2024-01--2028-12
（ 3 ） 基于不确定性建模的神经功能优化解析, 负责人, 国家任务, 2023-03--2027-02
（ 4 ） 人机物三元空间的情境感知与交互优化, 参与, 国家任务, 2022-01--2026-12
（ 5 ） 多模态情境因素影响的触控交互计算模型研究, 负责人, 国家任务, 2022-01--2025-12

已指导学生

盖鑫  硕士研究生  085405-软件工程  

现指导学生

肖一笑  硕士研究生  085405-软件工程