团队介绍
本团队由心理学、人因工程与计算机科学等多学科研究人员组成，主要围绕拟人化智能体设计与人因与智能交互两个方向开展交叉研究，综合运用心理学、人工智能、多模态行为建模等方法，探索人类认知与行为机制，推动人工智能与人机交互技术的发展。
方向一：拟人化智能体设计与应用。围绕专家型智能体与用户智能体开展研究。专家型智能体聚焦语言表达、情感交互、动作与表情生成，以及用户状态与意图识别，面向心理健康筛查、用户调研、教育陪伴和个人陪伴等场景开展应用研究。用户智能体基于大语言模型与心理、认知机制建模，模拟真实用户的认知、决策与行为，应用于消费者、飞行员等用户智能体研究，并进一步构建多智能体社会模拟环境，研究群体行为与社会互动。
方向二：人因与智能交互。围绕人在复杂人机系统中的感知、注意、认知、决策、操作及状态变化开展研究，重点关注工作负荷、认知疲劳、态势感知、决策行为等问题。结合眼动、语音、面部表情、生理信号和行为数据等多模态信息，开展人的状态识别、行为建模与人机交互研究，为智能穿戴、消费电子、智能汽车等产品的交互设计和用户体验优化提供理论与技术支撑。
团队成员
蒯曙光 教授
国家杰青，优青
智能交互学院院长
研究方向：心理与认知启发的智能体设计、交互与人工智能
邮箱：sgkuai@psy.ecnu.edu.cn
朱丹丹 副教授
研究方向：人工智能、多模态信息融合、视觉质量增强与恢复
邮箱：ddzhu@mail.ecnu.edu.cn
邓成龙 副研究员
研究方向：智能体交互、人因工程
邮箱：cldeng@psy.ecnu.edu.cn
谢鑫宇 晨晖学者（讲师）
研究方向：人机交互、智能体感知、社会认知
邮箱：xyxie@psy.ecnu.edu.cn
团队发表论文
会议论文
人工智能方向
Y. Kou, Y. Gu, C. Zhou, D.D. Zhu*, S.G. Kuai*, "RLSLM: A Hybrid Reinforcement Learning Framework Aligning Rule-Based Social Locomotion Model with Human Social Norms", AAAI，2026. (CCF A)
B. Tang, D.D. Zhu, S.G. Kuai*, C.L. Deng*, "TEAMo: Trait and Emotion Aware Motion Generation in 3D Human", ICASSP, 2026. (CCF B)
B. Tang, H.X. Zhang, X.J. Niu, R.Y. Sun, S.G. Kuai*, C.L. Deng*, "Beyond Naturalness: Metric-Guided Generation of Domain-Semantic 3D Motions", ICME, 2026. (Accepted, CCF B)
X.H. Kong, D.D. Zhu*, Z.H. Fan, et al., "Decoding Visual Individuality: The BF360 Dataset and a Personality-Driven Hierarchical Network for Scanpath Prediction", ACM MM, 2026. (Accepted, CCF A)
L.L. Zhong, D.D. Zhu*, X.H. Kong, K.W. Zhang, W. Sun, et al., "AdaptiveGaze: Emulating human-like adaptive vision for flexible Scanpath Prediction", ACM MM, 2026. (Accepted, CCF A)
X.H. Kong, D.D. Zhu*, et al., "SalDiff-DTM: A Novel Dual-Temporal Modulated Diffusion Model for Omnidirectional Images Scanpath Prediction", AAAI, 2026. (CCF A)
B. Tang, K.Q. Pan, M. Zheng, N. Zhou, J.L. Sui, D.D. Zhu, C.L. Deng*, S.G. Kuai*, "Pose as a Modality: A Psychology-Inspired Network for Personality Recognition with a New Multimodal Dataset", AAAI, 2025. (CCF A)
K.W. Zhang, D.D. Zhu*, X.K. Min, G.T. Zhai, "Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphics", AAAI, 2025. (CCF A)
K.W. Zhang, D.D. Zhu*, X.K. Min, G.T. Zhai, "Mesh Mamba: A Unified State Space Model for Saliency Prediction in Non-Textured and Textured Meshes", CVPR, 2025. (CCF A)
人机交互方向
Z.W. Jiang, S.G. Kuai*, C.L. Deng*, "Designing Emotion Feedback for Embodied Virtual Agents: A Continuous Emotional Intensity Model", CHI, 2026. (CCF A)
期刊论文
人工智能方向
C. Zhou, M.C. Miao, X.R. Chen, Y.F. Hu, Q. Chang, M.Y. Yan, S.G. Kuai*, "Human-behaviour-based social locomotion model improves the humanization of social robots", Nature Machine Intelligence, 4(11), 1040-1052, 2022.
C. Zhou, M. Han, Q. Liang, Y.F. Hu, S.G. Kuai*, "A social interaction field model accurately identifies static and dynamic social groupings", Nature Human Behaviour, 3, 847-855, 2019.
D.D. Zhu, K.W. Zhang, et al., "Developing Evolving Adaptability in Biological Intelligence: A Novel Biologically-Inspired Continual Learning Model for Video Saliency Prediction", IEEE TPAMI, vol. 48, pp. 4257-4274, 2026.
Y.C. Zhang, D.D. Zhu*, K.W. Zhang, K. Zhu, N.N. Zhang, X.K. Min, G.T. Zhai, "MEScan360: A Memory-Enhanced Scanpath Prediction Model for Omnidirectional Images", ACM Trans. Multim. Comput. Commun. Appl. 22(8), 212:1-212:22, 2026.
D.D. Zhu, K.W. Zhang, X.K. Min, G.T. Zhai, X.K. Yang, "From Haziness to Clarity: A Novel Iterative Memory-Retrospective Emergence Model for Omnidirectional Image Saliency Prediction", IEEE Trans. Image Process. 34, 3944-3959, 2025.
D.D. Zhu, K.W. Zhang, X.K. Min, G.T. Zhai, X.K. Yang, "ScanDTM: A Novel Dual-Temporal Modulation Scanpath Prediction Model for Omnidirectional Images", IEEE Trans. Circuits Syst. Video Technol. 35(8), 7850-7865, 2025.
K.W. Zhang, D.D. Zhu*, X.K. Min, G.T. Zhai, "Unified Approach to Mesh Saliency: Evaluating Textured and Non-Textured Meshes Through VR and Multifunctional Prediction", IEEE Trans. Vis. Comput. Graph. 31(5), 3151-3160, 2025.
M. Xiong, D.D. Zhu*, et al., "Audio-Visual Saliency Prediction Model with Implicit Neural Representation", ACM Trans. Multim. Comput. Commun. Appl. 21(4), 117:1-117:23, 2025.
D.D. Zhu, K.W. Zhang, N.N. Zhang, Q.Q. Zhou, X.K. Min, G.T. Zhai, X.K. Yang, "Unified Audio-visual Saliency Model for Omnidirectional Videos with Spatial Audio", IEEE Trans. Multim. 26, 764-775, 2024.
D.D. Zhu, K. Zhu, W.P. Ding, et al., "MTCAM: A Novel Weakly-Supervised Audio-Visual Saliency Prediction Model With Multi-Modal Transformer", IEEE Trans. Emerg. Top. Comput. Intell. 8(2), 1756-1771, 2024.
D.D. Zhu, K.W. Zhang, K. Zhu, et al., "From Discrete Representation to Continuous Modeling: A Novel Audio-Visual Saliency Prediction Model With Implicit Neural Representations", IEEE Trans. Emerg. Top. Comput. Intell. 8(6), 4059-4074, 2024.
D.D. Zhu, X. Shao, Q.Q. Zhou, X.K. Min, G.T. Zhai, X.K. Yang, "A Novel Lightweight Audio-visual Saliency Model for Videos", ACM Trans. Multim. Comput. Commun. Appl. 19(4), 147:1-147:22, 2023.
人因与人机交互方向
C.L. Deng, L. Sun, C. Zhou, S.G. Kuai*, "Dual-gain mode of head-gaze interaction improves the efficiency of object positioning in a 3D virtual environment", International Journal of Human–Computer Interaction, 40(8), 2067-2082, 2024.
C.L. Deng, C.Y. Tian, S.G. Kuai*, "A combination of eye-gaze and head-gaze interactions improves efficiency and user experience in an object positioning task in virtual environments", Applied Ergonomics, 103, 103785, 2022.
C.L. Deng, P. Geng, Y.F. Hu, S.G. Kuai*, "Beyond Fitts’s Law: A Three-Phase Model Predicts Movement Time to Position an Object in an Immersive 3D Virtual Environment", Human Factors, 61(6), 879-894, 2019.
心理与认知神经科学方向
J.X. Wang, Y.X. Xue, Y.-T. Zhang, S.G. Kuai*, X.Y. Xie*, "Humanizing virtual agents through mutual self-disclosure: Enhancing interpersonal engagement and cooperative behavior", Acta Psychologica, vol. 265, Art. no. 106752, 2026.
J.P. Zhu, X.Y. Xie*, C. Yu, J.Y. Zhang, "Double training promotes retinotopic transfer of category learning", npj Science of Learning, vol. 11, no. 1, 2026.
C. Terzo, D.C. Burr, X.Y. Xie, M.C. Morrone, "Saccade-synchronized alpha rhythms predict strength of memory trace of stimulus orientation", BMC Biology, vol. 24, Art. no. 146, 2026.
Y. Chen, X.Y. Xie*, "Opposing effects of prior information on relational representation and visual cues in dynamic social interaction perception", i-Perception, vol. 16, no. 3, Art. no. 20416695251340298, 2025.
X.Y. Xie*, D.C. Burr, M.C. Morrone, "Recent, but not long-term, priors induce behavioral oscillations in peri-saccadic vision", Communications Psychology, vol. 3, Art. no. 41, 2025.
W. Liu, J. Li, Y. Zhao, X.Y. Xie, G.M. Cicchini, "Signatures of a direct sense of number", Frontiers in Psychology, vol. 15, Art. no. 1430354, 2024.
X.Y. Xie, M.C. Morrone, D.C. Burr, "Serial dependence in orientation judgments at the time of saccades", Journal of Vision, vol. 23, no. 7, Art. no. 7, 2023.
S.G. Kuai, Z.K.D. Shan, J. Chen, Z.X. Xu, J.M. Li, D. Field, L. Li, "Integration of motion and form cues for the perception of self-motion in the human brain", Journal of Neuroscience, 40(5), 1120-1132, 2020.
X.Y. Xie, X.N. Zhao, C. Yu, "Perceptual learning of motion direction discrimination: Location specificity and the roles of dorsal and ventral areas", Vision Research, vol. 175, pp. 51-57, 2020.
X.Y. Xie, L. Liu, C. Yu, "A new perceptual training strategy to improve vision impaired by central vision loss", Vision Research, vol. 174, pp. 69-76, 2020.
X.Y. Xie, C. Yu, "A new format of perceptual learning based on evidence abstraction from multiple stimuli", Journal of Vision, vol. 20, no. 2, Art. no. 5, 2020.
X.Y. Xie, C. Yu, "Perceptual learning of Vernier discrimination transfers from high to zero noise after double training", Vision Research, vol. 156, pp. 39-45, 2019.
X.Y. Xie, C. Yu, "Double training downshifts the threshold vs. noise contrast (TvC) functions with perceptual learning and transfer", Vision Research, vol. 152, pp. 3-9, 2018.
S.G. Kuai, W. Li, C. Yu, Z. Kourtzi, "Contour integration over time: psychophysical and fMRI evidence", Cerebral Cortex, 27(5), 3042-3051, 2017.
L. Zhou, C.L. Deng, T.L. Ooi, Z.J. He, "Attention modulates perception of visual space", Nature Human Behaviour, 1(1), 0004, 2017.
R. Wang#, J. Wang#, J.Y. Zhang#, X.Y. Xie#, Y.X. Yang, S.H. Luo, C. Yu, W. Li, "Perceptual learning at a conceptual level", Journal of Neuroscience, vol. 36, no. 7, pp. 2238-2246, 2016.
Y.Z. Xiong#, X.Y. Xie#, C. Yu, "Location and direction specificity in motion direction learning associated with a single-level method of constant stimuli", Vision Research, vol. 119, pp. 9-15, 2016.
S.G. Kuai, D. Levi, Z. Kourtzi, "Learning optimizes decision templates in the human visual cortex", Current Biology, 23(18), 1799-1804, 2013.
S.G. Kuai#, J.Y. Zhang#, S.A. Klein, D.M. Levi, C. Yu, "The essential role of stimulus temporal patterning in enabling perceptual learning", Nature Neuroscience, 8(11), 1497-1499, 2005.
科研项目
国家杰出青年科学基金项目（A类），人类行为的计算模型和应用，2025.01-2029.12，在研，主持。
国家自然科学基金面上项目，62377011，课堂情境下视听感知驱动的个性化导学模型构建与应用研究，2024.01-2027.12，在研，主持。
上海市教委科技项目，基于AI 数字人技术的个性化虚拟老师构建，2024.12-2025.12，已结题，主持。
上海市白玉兰人才计划浦江项目（C类），2023PJC039，虚拟社会合作关系的建立机制及应用，2023.10-2026.10，在研，主持。
科技创新2030 —“脑科学与类脑研究”重大项目课题，社会交互行为感知的神经机制，2022.08-2027.07，在研，主持。
国家自然科学基金青年科学基金项目（C类），三维虚拟空间中转头瞄准运动目标的影响因素和操作特性，2022.01-2024.12，已结题，主持。
国家优秀青年科学基金项目（B类），视觉整合神经机制，2021.01-2023.12，已结题，主持。
国家自然科学基金青年科学基金项目（C类），62001289，面向VR/AR场景的类脑视觉显著性预测模型研究，2021.01-2023.12，已结题，主持。
中央高校专项基金自由探索项目，脑启发式VR/AR场景的类脑视觉显著性预测研究，2021.11-2022.10，已结题，主持。
国家自然科学基金青年科学基金项目（C类），31900799，基于规则的知觉学习——神经机制及模型研究，2020.01-2022.12，已结题，主持。
国家自然科学基金面上项目，人类内在空间参照系对角度知觉的影响，2018.01-2021.12，已结题，主持。
国家自然科学基金面上项目（小额），时空整合的心理和脑机制研究，2016.01-2017.12，已结题，主持。
国家社科基金重大课题（第二批）（子课题负责人），基于虚拟现实的实验研究对实验哲学的超越，2015.11-2022.12，已结题，主持。
企业合作单位
小米，OPPO，飞利浦（中国），标准化研究院等。
