Sound2Haptic: A Toolkit for Multichannel Haptics Across Multiple Form Factors
An open-source toolkit for researchers to build haptic feedback systems for auditory augmentation | UIST 2024
Project Overview
Sound2Haptic is a toolkit that addresses two fundamental challenges in haptic prototyping: the complexity of external hardware and the difficulty of creating customizable form factors. The system combines an 8-channel audio-based haptic driver with a parametric fabrication workflow, enabling researchers and designers to rapidly prototype wearable haptic devices across different body locations and configurations.
Technical Architecture
The toolkit consists of three main components:
- Hardware Platform: A plug-and-play device integrating an 8-channel sound card and amplifiers in a single unit. The system connects via USB to phones, laptops, or XR headsets, eliminating the need for complex external audio interfaces or separate amplification circuits.
- Fabrication System: A novel approach to passive vibration isolation using actuators suspended with woven thread inside 3D-printed frames. This method provides mechanical decoupling between actuators while maintaining a compact, lightweight form factor suitable for wearable applications.
- Parametric Design Tool: A Grasshopper-based interface that allows users to define actuator layouts through simple parameters (number of actuators, spacing, arrangement) and automatically generates 3D-printable geometry. This enables rapid iteration on device configurations without manual CAD work.
Fabrication Workflow
Creating a haptic device follows a streamlined seven-step process:
- Adjust sliders in Grasshopper to control array parameters
- Export 3D-printable geometry from Rhino
- 3D-print the actuator array frame and inner actuator rings
- Attach inner rings to the frame using the weaving process
- Solder LRA actuators to wires connected to the PCB
- Press-fit actuators into the inner rings
- Connect the device to a phone, laptop, or XR headset via USB
This workflow enables fabrication of custom haptic devices in hours rather than weeks, significantly accelerating the prototyping cycle.
Psychophysical Evaluation
We conducted evaluations comparing device performance across different form factors and body locations. The studies examined average threshold detection levels across device types and measured accuracy by motor position, providing validation of the fabrication approach and informing optimal actuator placement strategies.
Example Applications
The toolkit has been used to create haptic devices in multiple configurations:
- Wrist-worn arrays for spatial navigation cues
- Fingertip devices for texture simulation
- Torso-mounted systems for directional guidance
- Head-mounted interfaces for immersive experiences
Each demonstrates the flexibility of the parametric design system and the effectiveness of the passive vibration isolation approach across different mechanical constraints and wearing conditions.
Design Contributions
Sound2Haptic makes three key contributions to haptic prototyping:
- Unified hardware platform: Eliminates the need for separate sound cards, amplifiers, and custom electronics
- Scalable fabrication method: Thread-based suspension provides vibration isolation without bulky mechanisms
- Parametric design workflow: Enables non-experts to create custom haptic devices through high-level parameters rather than detailed CAD modeling
This combination significantly lowers the barrier to entry for haptic research and interaction design, enabling broader exploration of tactile feedback across applications from sensory augmentation to virtual reality.
This work was demonstrated at UIST 2024.
For more information, please read the paper or see the poster.