About Me

I am passionate about leveraging human-centered AI to drive positive societal impact, create emotionally intelligent systems, and promote equitable opportunities for all. My core interest lies in utilizing deep behavioral insights from non-verbal cues (πŸ‘€πŸ§ ) to better understand human thought processes, interactions, and decision-making patterns.
    With over 7 years of experience in machine learning, I specialize in multimodal AI, including eye gaze movement, behavioral analysis, and time-series data. My approach integrates domain expertise with AI, ensuring that technology is not just innovative but also meaningful, ethical, and socially responsible. I focus on building tech with intuition and purpose, designing systems that enhance adaptive interfaces, user-centric applications, and inclusive, empathetic interactions.
    By bridging foundational AI research and real-world applications, my work ensures that AI evolves beyond raw intelligence, fostering human-AI collaboration that is intuitive, responsible, and transformative. I believe in shaping AI that respects and amplifies human cognition, empowering people through technology while keeping the ethical and emotional dimensions of AI at the forefront.

Education

Ph.D. in Computer Science and Engineering

University of California, Santa Cruz (2021 - )

Master and Bachelor's in Computer Science

Kookmin University (Graduated in 2021)

Experiences

Research Scientist Intern

2024.6 - 2025.2

Meta, Redmond, WA

Reality Labs - Audio team

Applied Scientist Intern

2022.6 - 2022.9

Amazon, Seattle, WA

Computer Vision and NLP team

Publications

  • Mouse-Guided Gaze; Semi-Supervised Learning of Intention-Aware Representations for Reading Detection
  • Seongsil Heo, Roberto Manduchi, In NeurIPS Foundation Models for the Brain and Body Workshop, 2025
  • Gaze-Enhanced Multimodal Turn-Taking Prediction in Triadic Conversations
  • Seongsil Heo, Calvin Murdock, Michael Porulx, Christi Miller, In InterSpeech, 2025
  • Reading with Screen Magnification; Eye Movement Analysis Using Compensated Gaze Tracks
  • Seongsil Heo, Roberto Manduchi, and Suzana Chung, In ACM Symposium on Eye Tracking Research & Applications(ETRA), MULTIPLEYE, 2024
  • Eye Movement Analysis for Low Vision Readers Using a Full Screen Magnifier
  • Roberto Manduchi, Seongsil Heo, Suzana Chung, 2024
  • Sage; A Multimodal Knowledge Graph-based Conversational Agent for Complex Task Guidance
  • Kaizhi Z., Jesh B., Bhrigu G., Seongsil Heo, Vignesh, DJ S., Winson C., Shree V., Wang E., 2023
  • Stress Detection with Single Sensor PPG by Orchestrating Multiple Denoising and Peak Detection Method
  • Seongsil Heo, Sunyoung Kwon, and Jaekoo Lee, In IEEE Access, 2021
  • Learning from Time Series
  • Seongsil Heo, In Kookmin University, Seoul, Korea, 2021
  • Unsupervised Representation Learning for ECG-based Stress Detection (Best Paper Award)
  • Seongsil Heo, Jaekoo Lee, In IEMEK Symposium on Embedded Technology, 2021
  • PPG signal processing and comparison study with learning-based model for stress detection (Best Paper Award)
  • Seongsil Heo, Inkyung Kim, Sunyoung Kwon, Hyejin Lee and Jaekoo Lee, In Proceedings of Symposium of the Korean Institute of communications and Information Sciences, 2020