Real-Time Segmentation and Recognition of Surgical Tasks in Cataract Surgery Videos.
Saved in:
| Title: | Real-Time Segmentation and Recognition of Surgical Tasks in Cataract Surgery Videos. |
|---|---|
| Authors: | Quellec, Gwenole1, Lamard, Mathieu1, Cochener, Beatrice1, Cazuguel, Guy1 |
| Source: | IEEE Transactions on Medical Imaging. Dec2014, Vol. 33 Issue 12, p2352-2360. 9p. |
| Subjects: | Cataract surgery, Image segmentation, Content-based image retrieval, Random fields, Hidden Markov models |
| Abstract: | In ophthalmology, it is now common practice to record every surgical procedure and to archive the resulting videos for documentation purposes. In this paper, we present a solution to automatically segment and categorize surgical tasks in real-time during the surgery, using the video recording. The goal would be to communicate information to the surgeon in due time, such as recommendations to the less experienced surgeons. The proposed solution relies on the content-based video retrieval paradigm: it reuses previously archived videos to automatically analyze the current surgery, by analogy reasoning. Each video is segmented, in real-time, into an alternating sequence of idle phases, during which no clinically-relevant motions are visible, and action phases. As soon as an idle phase is detected, the previous action phase is categorized and the next action phase is predicted. A conditional random field is used for categorization and prediction. The proposed system was applied to the automatic segmentation and categorization of cataract surgery tasks. A dataset of 186 surgeries, performed by ten different surgeons, was manually annotated: ten possibly overlapping surgical tasks were delimited in each surgery. Using the content of action phases and the duration of idle phases as sources of evidence, an average recognition performance of Az = 0.832 \pm 0.070 was achieved. [ABSTRACT FROM AUTHOR] |
| Copyright of IEEE Transactions on Medical Imaging is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 100027701 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Real-Time Segmentation and Recognition of Surgical Tasks in Cataract Surgery Videos. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Quellec%2C+Gwenole%22">Quellec, Gwenole</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Lamard%2C+Mathieu%22">Lamard, Mathieu</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Cochener%2C+Beatrice%22">Cochener, Beatrice</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Cazuguel%2C+Guy%22">Cazuguel, Guy</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22IEEE+Transactions+on+Medical+Imaging%22">IEEE Transactions on Medical Imaging</searchLink>. Dec2014, Vol. 33 Issue 12, p2352-2360. 9p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Cataract+surgery%22">Cataract surgery</searchLink><br /><searchLink fieldCode="DE" term="%22Image+segmentation%22">Image segmentation</searchLink><br /><searchLink fieldCode="DE" term="%22Content-based+image+retrieval%22">Content-based image retrieval</searchLink><br /><searchLink fieldCode="DE" term="%22Random+fields%22">Random fields</searchLink><br /><searchLink fieldCode="DE" term="%22Hidden+Markov+models%22">Hidden Markov models</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: In ophthalmology, it is now common practice to record every surgical procedure and to archive the resulting videos for documentation purposes. In this paper, we present a solution to automatically segment and categorize surgical tasks in real-time during the surgery, using the video recording. The goal would be to communicate information to the surgeon in due time, such as recommendations to the less experienced surgeons. The proposed solution relies on the content-based video retrieval paradigm: it reuses previously archived videos to automatically analyze the current surgery, by analogy reasoning. Each video is segmented, in real-time, into an alternating sequence of idle phases, during which no clinically-relevant motions are visible, and action phases. As soon as an idle phase is detected, the previous action phase is categorized and the next action phase is predicted. A conditional random field is used for categorization and prediction. The proposed system was applied to the automatic segmentation and categorization of cataract surgery tasks. A dataset of 186 surgeries, performed by ten different surgeons, was manually annotated: ten possibly overlapping surgical tasks were delimited in each surgery. Using the content of action phases and the duration of idle phases as sources of evidence, an average recognition performance of Az = 0.832 \pm 0.070 was achieved. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of IEEE Transactions on Medical Imaging is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=100027701 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1109/TMI.2014.2340473 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 9 StartPage: 2352 Subjects: – SubjectFull: Cataract surgery Type: general – SubjectFull: Image segmentation Type: general – SubjectFull: Content-based image retrieval Type: general – SubjectFull: Random fields Type: general – SubjectFull: Hidden Markov models Type: general Titles: – TitleFull: Real-Time Segmentation and Recognition of Surgical Tasks in Cataract Surgery Videos. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Quellec, Gwenole – PersonEntity: Name: NameFull: Lamard, Mathieu – PersonEntity: Name: NameFull: Cochener, Beatrice – PersonEntity: Name: NameFull: Cazuguel, Guy IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 12 Text: Dec2014 Type: published Y: 2014 Identifiers: – Type: issn-print Value: 02780062 Numbering: – Type: volume Value: 33 – Type: issue Value: 12 Titles: – TitleFull: IEEE Transactions on Medical Imaging Type: main |
| ResultId | 1 |