AugTwins

AugTwins is a pipeline for creating interactive human digital twins that engage users in natural, face-to-face conversation. By integrating photorealistic embodiment (Unreal Engine MetaHuman), voice cloning, and a hybrid multi-agent memory architecture, the system enables realistic encounters with digital representations of real people. Each twin is grounded in the person’s life story, experiences, and knowledge while maintaining conversational continuity across sessions. The architecture combines fast pattern matching for common queries with deep semantic retrieval for biographical details, coordinated through metacognitive monitoring that guides socially appropriate responses. We present two deployed twins demonstrating faithful personality representation and accurate biographical recall. Beyond technical implementation, AugTwins invites reflection on how memory and embodiment shape identity, and what it means to extend human presence through computational reconstruction. Requests for name changes in the electronic proceedings will be accepted with no questions asked. However name changes may cause bibliographic tracking issues. Authors are asked to consider this carefully and discuss it with their co-authors prior to requesting a name change in the electronic proceedings. Use the "Report an Issue" link to request a name change. Do not remove: This comment is monitored to verify that the site is working properly