← All publications

ACM UIST'26 C4 - To appear

CineHaptic: Context-Aware Real-Time Audiovisual-to-Haptic Rendering System for In-Vehicle 4D Cinematic Experiences

Junwoo Kim, Hyunuk Kim, Hyun-Bin Oh, Jeonggoo Kang, Tae-Hyun Oh, Seungmoon Choi

ACM Symposium on User Interface Software and Technology (ACM UIST), 2026

CineHaptic pipeline from audiovisual event localization, salience classification, and audio processing to seat-based haptic patterns for an in-car 4D experience
CineHaptic pipeline from audiovisual event localization, salience classification, and audio processing to seat-based haptic patterns for an in-car 4D experience.

At a glance

How can audiovisual events become context-aware haptic feedback for an in-vehicle cinematic experience?

A context-aware system that translates audiovisual content into real-time haptic feedback for in-vehicle 4D cinematic experiences.

Audiovisual-to-hapticReal-time renderingIn-vehicle experience

The approach

The supplied system overview combines event sound localization, event salience classification, and audio signal processing. Event location, salience, and dynamics inform spatiotemporal haptic patterns delivered through a vehicle seat alongside video and audio.

Research highlights

  1. Context-aware event information

    Video and audio contribute information about event location, salience, and dynamics.

  2. Spatiotemporal haptic rendering

    The pipeline maps event information to haptic patterns distributed across the seat.

  3. In-vehicle 4D experience

    The illustrated application brings video, audio, and seat-based haptic feedback together in a cinematic experience inside a vehicle.

Research overview based on the paper title and author-provided figure. Publication listing · AMI Lab.

Citation

Publication details & BibTeX
Conference
ACM Symposium on User Interface Software and Technology (ACM UIST)
Proceedings
Proceedings of the ACM Symposium on User Interface Software and Technology
Year
2026
Publisher
Association for Computing Machinery
Status
To appear
BibTeX

@inproceedings{Kim26CineHaptic,
  title = {{CineHaptic: Context-Aware Real-Time Audiovisual-to-Haptic Rendering System for In-Vehicle 4D Cinematic Experiences}},
  author = {Kim, Junwoo and Kim, Hyunuk and Oh, Hyun-Bin and Kang, Jeonggoo and Oh, Tae-Hyun and Choi, Seungmoon},
  booktitle = {Proceedings of the ACM Symposium on User Interface Software and Technology},
  year = {2026},
  publisher = {Association for Computing Machinery},
  note = {To appear}
}

Provisional citation · To appear