Automated detection and annotation of toothed-whale whistles using transformer-based instance segmentation.
Saved in:
| Title: | Automated detection and annotation of toothed-whale whistles using transformer-based instance segmentation. |
|---|---|
| Authors: | Zhang, Xixin1,2 (AUTHOR), Liu, Xiaobai1 (AUTHOR) xiaobai.liu@sdsu.edu, Alksne, Michaela N.3 (AUTHOR), Roch, Marie A.1 (AUTHOR) marie.roch@sdsu.edu |
| Source: | Journal of the Acoustical Society of America. Jun2026, Vol. 159 Issue 6, p5693-5706. 14p. |
| Subjects: | Detection algorithms, Spectrograms, Bioacoustics, Whale sounds, Dolphin behavior |
| Abstract: | Accurate detection and fine-scale annotation of dolphin whistles are crucial for understanding marine mammal communication and population dynamics. Dolphin-whistle annotation is challenging due to highly variable signals, overlapping calls including echolocation clicks, attenuation, and noisy backgrounds. Most existing methods treat the task as a spectrogram peak-tracking problem, linking neighboring detected peaks using heuristic or statistical methods, and rely on manual feature engineering. While effective for long, clear whistles, they lack generalizability for short, weak whistles across species. We reformulated dolphin-whistle detection as an instance-segmentation task, introducing an end-to-end transformer model that predicted complete whistle contours directly from spectrograms, eliminating peak-detection and trajectory-reconstruction stages. To overcome manual labeling limitations, we integrated a human-in-the-loop training paradigm that iteratively refined annotations, improving both data quality and model performance. We demonstrated the effectiveness of this architecture on a subset of the detection, classification, localization, and density estimation 2011 corpus where we partitioned training and test data such that test data were from species, locations, and hydrophones that were excluded from the training data. Experiments showed that our end-to-end system generalized effectively in these conditions, achieving 89.99% precision and 80.65% recall for all whistles, and 85.81% precision with 88.44% recall for whistles longer than 150 ms. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of the Acoustical Society of America is the property of American Institute of Physics and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 194973354 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Automated detection and annotation of toothed-whale whistles using transformer-based instance segmentation. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zhang%2C+Xixin%22">Zhang, Xixin</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Liu%2C+Xiaobai%22">Liu, Xiaobai</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> xiaobai.liu@sdsu.edu</i><br /><searchLink fieldCode="AR" term="%22Alksne%2C+Michaela+N%2E%22">Alksne, Michaela N.</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Roch%2C+Marie+A%2E%22">Roch, Marie A.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> marie.roch@sdsu.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+the+Acoustical+Society+of+America%22">Journal of the Acoustical Society of America</searchLink>. Jun2026, Vol. 159 Issue 6, p5693-5706. 14p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Detection+algorithms%22">Detection algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Spectrograms%22">Spectrograms</searchLink><br /><searchLink fieldCode="DE" term="%22Bioacoustics%22">Bioacoustics</searchLink><br /><searchLink fieldCode="DE" term="%22Whale+sounds%22">Whale sounds</searchLink><br /><searchLink fieldCode="DE" term="%22Dolphin+behavior%22">Dolphin behavior</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Accurate detection and fine-scale annotation of dolphin whistles are crucial for understanding marine mammal communication and population dynamics. Dolphin-whistle annotation is challenging due to highly variable signals, overlapping calls including echolocation clicks, attenuation, and noisy backgrounds. Most existing methods treat the task as a spectrogram peak-tracking problem, linking neighboring detected peaks using heuristic or statistical methods, and rely on manual feature engineering. While effective for long, clear whistles, they lack generalizability for short, weak whistles across species. We reformulated dolphin-whistle detection as an instance-segmentation task, introducing an end-to-end transformer model that predicted complete whistle contours directly from spectrograms, eliminating peak-detection and trajectory-reconstruction stages. To overcome manual labeling limitations, we integrated a human-in-the-loop training paradigm that iteratively refined annotations, improving both data quality and model performance. We demonstrated the effectiveness of this architecture on a subset of the detection, classification, localization, and density estimation 2011 corpus where we partitioned training and test data such that test data were from species, locations, and hydrophones that were excluded from the training data. Experiments showed that our end-to-end system generalized effectively in these conditions, achieving 89.99% precision and 80.65% recall for all whistles, and 85.81% precision with 88.44% recall for whistles longer than 150 ms. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of the Acoustical Society of America is the property of American Institute of Physics and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=194973354 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1121/10.0044187 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 5693 Subjects: – SubjectFull: Detection algorithms Type: general – SubjectFull: Spectrograms Type: general – SubjectFull: Bioacoustics Type: general – SubjectFull: Whale sounds Type: general – SubjectFull: Dolphin behavior Type: general Titles: – TitleFull: Automated detection and annotation of toothed-whale whistles using transformer-based instance segmentation. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zhang, Xixin – PersonEntity: Name: NameFull: Liu, Xiaobai – PersonEntity: Name: NameFull: Alksne, Michaela N. – PersonEntity: Name: NameFull: Roch, Marie A. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 00014966 Numbering: – Type: volume Value: 159 – Type: issue Value: 6 Titles: – TitleFull: Journal of the Acoustical Society of America Type: main |
| ResultId | 1 |
