Full-Body Haptic Cueing for Augmented Pilot Perception in Position/Velocity Tracking Tasks

This paper investigates the use of multi-modal cueing through full-body haptic feedback to enhance pilot-vehicle system (PVS) performance, reduce mental workload (MWL), and increase situational awareness (SA) in both good and degraded visual environments (GVE/DVE). Piloted simulations were conducted using an H-60-like flight dynamics model in a virtual reality (VR) motion-based simulator, evaluating two ADS-33-like mission task elements (MTEs) – precision hover and slalom – under visual-only and combined visual and haptic feedback conditions in both GVE and DVE. The H-60 flight dynamics were augmented with a dynamic inversion (DI)- based stability augmentation system (SAS), implementing rate-command/attitude hold (RCAH) response type on the roll, pitch, and yaw axes and altitude hold response type on the vertical axis. The SAS was designed to achieve Level 1 handling qualities per ADS-33 standards. The full-body haptic cueing strategy leveraged an outer-loop DI control law, which provided vibrotactile feedback to cue desired roll, pitch, and yaw attitudes to the pilot. Roll cues were delivered via tactors mounted on the upper arms, pitch cues via tactors on the chest and back, and yaw cues via tactors on the calves. Eight test subjects participated in the piloted simulations, including three U.S. Navy test pilots and five subjects with different flying experiences. Results indicated that haptic feedback significantly improved hover performance, reducing MWL and enhancing SA, particularly in DVE. However, in the slalom task, predefined haptic guidance misaligned with pilots’ individual control strategies, leading to performance degradation. This finding highlights the need for pilot-specific adaptive haptic feedback to mitigate inconsistencies in dynamic maneuvering tasks.