Evaluating behavioral intervention technologies: Integrating human-centered design and implementation science outcomes

Background Behavioral intervention technologies (BITs) offer scalable, cost-effective healthcare solutions but often show reduced impacts in community settings and are rarely sustained. Human-centered design (HCD) enhances usability by tailoring BITs to stakeholder needs, while implementation science (IS) identifies contextual barriers and strategies to promote uptake and sustainability. Both HCD and IS aim to improve BIT usability and implementation through iterative, user-focused processes but are rarely integrated. Objective We introduced the user-centered and sustainable implementation science (USIS) model, a novel and systematic framework that combines HCD and IS principles to enhance BIT effectiveness and sustainability. We aimed to (1) synthesize the HCD and IS outcomes and integrate them into a USIS framework; (2) apply USIS to a case study: the sleep shared-management intervention for children with juvenile idiopathic arthritis and their parents (SLEEPSMART). Methods We conducted a narrative literature review on HCD and IS outcomes for BITs from the PubMed, CINAHL, and Web of Science databases. Articles were selected based on their focus on usability, implementation outcomes, and evidence-based healthcare practices. This synthesis informed the development of the USIS model. Results The USIS model incorporates five domains: (1) user-centeredness (empathy, engagement, and equity), (2) efficiency (cost, timeliness, and rapidity), (3) feasibility (learnability, memorability, error reduction, and low cognitive load), (4) satisfaction (acceptability and appropriateness), and (5) fidelity (adoption, penetration, and sustainability). We applied the USIS model to evaluate the SLEEPSMART project to demonstrate the application of the USIS model in guiding BIT design and refinement. Insights from the review informed the design principles applied during the development and testing stages of SLEEPSMART. Conclusion The USIS model serves as a practical and theoretical guide to improve BIT design and evaluation. By emphasizing implementation considerations early and centering user needs, USIS provides a pathway to bridge HCD and IS approaches to enhance the real-world impact and sustainability of digital health innovations.