RESEARCH PROJECT SUMMARY

Blurring the Boundary Between Reality and Virtuality: Research on Novel Haptic Devices

Creation and evaluation of a small, lightweight haptic system that uses electrical muscle stimulation (EMS) combined with biomechanical simulation to stimulate multiple muscles simultaneously, providing users with precise directional haptic force feedback [c.5, w.4]
Improvement of the response time limitations of previous thermal haptic devices by using motorized Peltier modules, creating a device capable of providing a high level of realism in situations requiring rapid sensory transitions [c.8, w.1]
Development of exemplary VR applications utilizing haptic devices in industrial settings [c.8, w.4] and VR game content [c.5, c.8, w.1]

Towards Seamless Walking in Virtual Environments: Redirected Walking (RDW)

Development and usability testing of various haptic systems to enhance the obstacle avoidance capability of RDW technology, overcoming the physical limitations of real-world space, thereby enhancing the seamless walking experience
Creation of haptic devices that can provide vestibular stimulation (galvanic, bone conduction vibration, thermal) [c.1, c.3, p.2, pa.1], olfactory stimulation, auditory stimulation [j.2, p.1], and visual stimuli with optical flow [j.1], along with algorithms to determine the optimal type and timing of stimulation
Further implementation of algorithms to improve RDW's spatial scalability by predicting user paths through real-time sensing of walking data and deep learning-based user path prediction – responsible for implementing the real-time gait sensor streaming system [p.4]

Utilizing Haptic Technology for Accessibility

Development and implementation of a hat-shaped haptic device that induces the “Hanger reflex” to expand the field of vision for people with low vision [c.6]
Development of an intelligent walker that integrates pressure sensors, linear actuators, and motorized wheels, dynamically changing its form to match the patient's intent and the surrounding environment, aimed at improving rehabilitation performance for patients with lower body motor impairments [w.2]

Interactions Between Autonomous Vehicles (AVs) and People

Development and evaluation of a haptic system that activates muscles via EMS based on the content and movement of the vehicle to address motion sickness, a major limitation of VR use in AVs [c.4, w.3]
Development and evaluation of an in-car VR locomotion system that allows users to freely explore the environment, rather than simply observing content on predetermined routes [p.3, cc.1, cc.2]
Creation and distribution of a comprehensive dataset of AV passengers’ real-time needs and biometric signals [c.7]
Development and design evaluation of an AR-based virtual agent for communication between AVs and pedestrians [c.2]

CONFERENCES & PUBLICATIONS

[c.8] Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual Reality
Kang, S., Kim, G., Hwang, S., Park, J., Elsharkawy, A., and Kim, S.
UIST '24: Proceedings of the ACM Symposium on User Interface Software and Technology - Link

[w.4] Proposal of a Framework for Enhancing Teleoperation Experience with Biomechanical Simulation-Based Electrical Muscle Stimulation in Virtual Reality
Hwang, S., Kang, S., Oh, J., Park, J., Shin, S., Yiyue Luo, Joseph DelPreto, Wojciech Matusik, Daniela Rus, and Kim, S.
UbiComp/ISWC '24 Adjunct - Link

[w.3] Adaptive In-Vehicle Virtual Reality for Reducing Motion Sickness: Manipulating Passenger Posture During Driving Events
Elsharkawy, A., Ataya, A., Yeo, D., Seong, M., Hwang, S., Joseph DelPreto, Wojciech Matusik, Daniela Rus, and Kim, S.
UbiComp/ISWC '24 Adjunct - Link

[c.7] TimelyTale: A Multimodal Dataset Assessing Passenger's Demands for Explanations in Highly Automated Vehicles
Kim, G., Hwang, S., Seong, M., Yeo, D., Daniela Rus, and Kim, S.
Proceedings of the ACM on IMWUT - Link

[w.2] Intelligence Walker: A Seamless Mobility Assist Device for the Elderly
Choi, Y., Yeo, D., Hwang, S., Seong, M., Moon, J., Yiyue Luo, Wojciech Matusik, Daniela Rus, and Kim, K.
2024 IEEE ICRA Workshop on Wearable - Link

[w.1] Dual-sided Peltier Elements for Rapid Thermal Feedback in Wearables
Kang, S., Kim, G., Hwang, S., Park, J., Elsharkawy, A., and Kim, S.
2024 IEEE ICRA Workshop on Wearable - Link

[c.6] WatchCap: Improving Scanning Efficiency in People with Low Vision through Compensatory Head Movement Stimulation
Jo, T., Yeo, D., Kim, G., Hwang, S., and Kim, S.
Proceedings of the ACM on IMWUT - Link

[c.5] ErgoPulse: Electrifying Your Lower Body With Biomechanical Simulation-based Electrical Muscle Stimulation Haptic System in Virtual Reality
🏆 Honorable mention
Hwang, S., Oh, J., Kang, S., Seong, M., Elsharkawy, A., and Kim, S.
Proceedings of the 2024 CHI - Link

[c.4] SYNC-VR: Synchronizing Your Senses to Conquer Motion Sickness for Enriching In-Vehicle Virtual Reality
🏆 Honorable mention
Elsharkawy, A., Ataya, A., Yeo, D., An, E., Hwang, S., and Kim, S.
Proceedings of the 2024 CHI - Link

[p.4] GaitWay: Gait Data-Based VR Locomotion Prediction System Robust to Visual Distraction
Kim, Y., Hwang, S., Oh, J., and Kim, S.
Extended Abstracts of the 2024 CHI (Late-Breaking Work) - Link

[p.3] Curving the Virtual Route: Applying Redirected Steering Gains for Active Locomotion in In-Car VR
Gim, B., Kang, S., Kim, G, Yeo, D., Hwang, S., and Kim, S.
Extended Abstracts of the 2024 CHI (Late-Breaking Work) - Link

[j.2] Evaluation of Visual, Auditory, and Olfactory Stimulus-Based Attractors for Intermittent Reorientation in Virtual Reality Locomotion
Lee, J., Hwang, S., Kim, K., and Kim, S.
Virtual Reality - Link

[j.1] Effect of Optical Flow and User VR Familiarity on Curvature Gain Thresholds for Redirected Walking
Lee, J., Hwang, S., Ataya, A., and Kim, S.
Virtual Reality - Link

[c.3] Enhancing Seamless Walking in Virtual Reality: Application of Bone-Conduction Vibration in Redirected Walking
🏆 Honorable mention
Hwang, S., Kim, Y., Seo, Y., and Kim, S.
2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) - Link

[c.2] Designing Virtual Agent Human–Machine Interfaces Depending on the Communication and Anthropomorphism Levels in Augmented Reality
🏆 Honorable mention
Kang, Y., Choi, S., An, E., Hwang, S., and Kim, S.
AutomotiveUI 2023 - Link

[c.1] Electrical, Vibrational, and Cooling Stimuli-Based Redirected Walking: Comparison of Various Vestibular Stimulation-Based Redirected Walking Systems
Hwang, S., Lee, J., Kim, Y., Seo, Y., and Kim, S.
Proceedings of the 2023 CHI - Link

[p.2] REVES: Redirection Enhancement Using Four-Pole Vestibular Electrode Stimulation
Hwang, S., Lee, J., Kim, Y., and Kim, S.
Extended Abstracts of the 2022 CHI (Late-Breaking Work) - Link

[p.1] Auditory and Olfactory Stimuli-Based Attractors to Induce Reorientation in Virtual Reality Forward Redirected Walking
Lee, J., Hwang, S., Kim, K., and Kim, S.
Extended Abstracts of the 2022 CHI (Late-Breaking Work) - Link

Patents & Copyrighted Contents

[pa.1] Method and System for Supporting Walking in Virtual Environment
Hwang, S., Lee, J., Kim, Y., Seo, Y., and Kim, S.
US Patent App. 18/783,599 || KR Patent App. 10-2023-0,155,898

[cc.2] Mobility-Linked Virtual Reality-Based Underwater Exploration Immersive Content Game Software (Underwater Exploration & Ocean Trash Collection Game)
Kim, S., Kang, S., Kang, Y., Kim, K., Seong, M., An, E., Yang, H., Yeo, D., Oh, J., Jeon, H., Jo, T., and Hwang, S.
Copyright for Computer Program Works C-2022-050134

[cc.1] Mobility-Linked Virtual Reality-Based Underwater Exploration Immersive Content Game Software (Underwater Exploration & Underwater Gem Collection Game)
Kim, S., Kang, S., Kang, Y., Kim, K., Seong, M., An, E., Yang, H., Yeo, D., Oh, J., Jeon, H., Jo, T., and Hwang, S.
Copyright for Computer Program Works C-2022-050133