KARVIMIO is a project by the Friedrich-Alexander-Universität Nuremberg-Erlangen. The abbreviation stands for “KI-basierte Augmented Reality Visualisierung von Bedienungsanleitungen medizinischer Instrumente im Operationssaal” (AI-based augmented reality visualisation of instructions for medical instruments in the operating theatre).
KARVIMIO is a three-year project funded by the BMBF. The project aims to develop an Artificial Intelligence (AI) based Augmented Reality (AR) assistance system for the operating room in hospitals. The system will utilize AI-powered object recognition and tracking through camera sensors to automatically identify and monitor medical instruments. Through AR glasses, the medical staff can access relevant operating instructions in real-time, improving efficiency and patient safety. The goal is to address common challenges in instrument handling during surgeries, reducing the reliance on paper or PDF manuals and minimizing disruptions in patient care.
Instructions for any kind of complex workflow (operation of machinery, conducting a chemical experiment, …) could be blended in via AR goggles so there is less need to consult a handbook.
AR
Hardware: HoloLens
Software: Dynamics 365 Guides