In Science advances
Laparoscopic surgery has evolved as a key technique for cancer diagnosis and therapy. While characterization of the tissue perfusion is crucial in various procedures, such as partial nephrectomy, doing so by means of visual inspection remains highly challenging. We developed a laparoscopic real-time multispectral imaging system featuring a compact and lightweight multispectral camera and the possibility to complement the conventional surgical view of the patient with functional information at a video rate of 25 Hz. To enable contrast agent-free ischemia monitoring during laparoscopic partial nephrectomy, we phrase the problem of ischemia detection as an out-of-distribution detection problem that does not rely on data from any other patient and uses an ensemble of invertible neural networks at its core. An in-human trial demonstrates the feasibility of our approach and highlights the potential of spectral imaging combined with advanced deep learning-based analysis tools for fast, efficient, reliable, and safe functional laparoscopic imaging.
Ayala Leonardo, Adler Tim J, Seidlitz Silvia, Wirkert Sebastian, Engels Christina, Seitel Alexander, Sellner Jan, Aksenov Alexey, Bodenbach Matthias, Bader Pia, Baron Sebastian, Vemuri Anant, Wiesenfarth Manuel, Schreck Nicholas, Mindroc Diana, Tizabi Minu, Pirmann Sebastian, Everitt Brittaney, Kopp-Schneider Annette, Teber Dogu, Maier-Hein Lena
2023-Mar-10
