Yudam Shin

Research

I study how AI can understand human emotion and behavior, and how these capabilities become responsive interactive systems.

My work spans multimodal emotion recognition, synthetic data for avatar behavior, and real-time interaction in XR. Undergraduate research at Graphics Realization Lab, Chung-Ang University.

Publications

  1. 2026 · International conference

    Single-Image-Driven Automated 3D Avatar Generation and Real-Time Motion Retargeting Pipeline for Immersive Exhibition Interaction

    G. Kim, Y. Shin, S. Seo

    MASP 2026

  2. 2026 · Domestic conference

    전시 환경에서의 단일 이미지 기반 3D 아바타 생성 및 실시간 모션 리타겟팅 파이프라인 연구

    김건, 신유담, 서상현

    한국멀티미디어학회 · Spring Conference

  3. 2025 · International conference

    Enhancing Deep Learning for Pine Wilt Disease Detection Using 3D Virtual Synthetic Data

    G. Kim, Y. Shin, S. Seo

    PlatCon 2025

  4. 2025 · Domestic conference

    SNS 영상 데이터 분석을 통한 전시 후기 분석과 경험 시각화 모델 연구: 릴스(Reels)를 중심으로

    신유담, 임태빈, 서상현

    한국멀티미디어학회, 우수논문상 · Spring Conference

  5. 2025 · Journal

    불완전한 데이터 상황에서 각성도 및 긍·부정도를 적용한 멀티모달 감정 인식 모델

    신유담, 신원섭, 서상현

    한국전자거래학회지 30(2), 1–14

  6. 2025 · International conference

    A Multi-Modal Emotion Recognition Model Incorporating Arousal and Valence with Incomplete Data

    Y. Shin, Y. Kang, B. Kim, S. Seo

    MASP 2025

  7. 2024 · Domestic conference

    각성도 및 긍·부정도를 적용한 멀티모달 감정인식 모델

    신유담, 김범수, 서상현

    스마트미디어&전자거래학회, 우수논문상 · Fall Conference

  8. 2024 · International conference

    Adapting the Valence_Arousal Model for Multimodal Emotion Recognition with Incomplete Data

    Y. Shin, S. Seo

    PlatCon 2024

  9. 2023 · Domestic conference

    메타버스 내 어뷰징 행동 탐지를 위한 데이터셋 구축 연구

    신유담, 오창진, 조용규, 서상현

    한국멀티미디어학회 · Fall Conference

Research & projects

2025 · PM · Technical director · Motion capture & retargeting

TERARiUM

Connected visitor sketches to responsive 3D characters. Built Kinect-to-Unity retargeting, UniRig joint mapping, and face-based visitor re-identification; integrated the team’s generation pipeline.

Read case study ↗

2024–2025 · First author · Model design, implementation & experiments

Multimodal emotion recognition

Studied arousal and valence representations for speech–text emotion recognition with incomplete modalities. Led model design, implementation, experiments, and analysis.

Read case study ↗

2023–2025 · Behavior definition · Survey · Motion & data production

Metaverse behavior & synthetic data

Contributed to defining abusive avatar behaviors, a participant survey, and synthetic-data production using motion capture, motion generation, Blender, and Unity Perception.

Read case study ↗

2025 · PM · Flutter full-stack development

Mindy

Built an MVP for child–parent emotional communication, from parent interviews and product research to a Flutter application with voice conversation and parent reports.

Read case study ↗

2023 · PM · Development · Two-person course project

Echotion

Connected speech recognition, KoBERT emotion classification, and expressive subtitles in a desktop interface.

Read case study ↗