View in EDS

Real-Time Task Recognition in Cataract Surgery Videos Using Adaptive Spatiotemporal Polynomials.

Saved in:
Bibliographic Details
Title: Real-Time Task Recognition in Cataract Surgery Videos Using Adaptive Spatiotemporal Polynomials.
Authors: Quellec, Gwenole1, Lamard, Mathieu2, Cochener, Beatrice2, Cazuguel, Guy3
Source: IEEE Transactions on Medical Imaging. Apr2015, Vol. 34 Issue 4, p877-887. 11p.
Subjects: Cataract surgery, Ophthalmic surgery, Eye physiology, Fuzzy systems, Algorithms, Spatiotemporal processes
Abstract: This paper introduces a new algorithm for recognizing surgical tasks in real-time in a video stream. The goal is to communicate information to the surgeon in due time during a video-monitored surgery. The proposed algorithm is applied to cataract surgery, which is the most common eye surgery. To compensate for eye motion and zoom level variations, cataract surgery videos are first normalized. Then, the motion content of short video subsequences is characterized with spatiotemporal polynomials: a multiscale motion characterization based on adaptive spatiotemporal polynomials is presented. The proposed solution is particularly suited to characterize deformable moving objects with fuzzy borders, which are typically found in surgical videos. Given a target surgical task, the system is trained to identify which spatiotemporal polynomials are usually extracted from videos when and only when this task is being performed. These key spatiotemporal polynomials are then searched in new videos to recognize the target surgical task. For improved performances, the system jointly adapts the spatiotemporal polynomial basis and identifies the key spatiotemporal polynomials using the multiple-instance learning paradigm. The proposed system runs in real-time and outperforms the previous solution from our group, both for surgical task recognition (A_z = 0.851 on average, as opposed to A_z = 0.794 previously) and for the joint segmentation and recognition of surgical tasks (A_z = 0.856 on average, as opposed to A_z = 0.832 previously). [ABSTRACT FROM PUBLISHER]
Copyright of IEEE Transactions on Medical Imaging is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:This paper introduces a new algorithm for recognizing surgical tasks in real-time in a video stream. The goal is to communicate information to the surgeon in due time during a video-monitored surgery. The proposed algorithm is applied to cataract surgery, which is the most common eye surgery. To compensate for eye motion and zoom level variations, cataract surgery videos are first normalized. Then, the motion content of short video subsequences is characterized with spatiotemporal polynomials: a multiscale motion characterization based on adaptive spatiotemporal polynomials is presented. The proposed solution is particularly suited to characterize deformable moving objects with fuzzy borders, which are typically found in surgical videos. Given a target surgical task, the system is trained to identify which spatiotemporal polynomials are usually extracted from videos when and only when this task is being performed. These key spatiotemporal polynomials are then searched in new videos to recognize the target surgical task. For improved performances, the system jointly adapts the spatiotemporal polynomial basis and identifies the key spatiotemporal polynomials using the multiple-instance learning paradigm. The proposed system runs in real-time and outperforms the previous solution from our group, both for surgical task recognition (A_z = 0.851 on average, as opposed to A_z = 0.794 previously) and for the joint segmentation and recognition of surgical tasks (A_z = 0.856 on average, as opposed to A_z = 0.832 previously). [ABSTRACT FROM PUBLISHER]
ISSN:02780062
DOI:10.1109/TMI.2014.2366726