ContextAD: Context-Aware Acronym Disambiguation with Siamese BERT Network.
Saved in:
| Title: | ContextAD: Context-Aware Acronym Disambiguation with Siamese BERT Network. |
|---|---|
| Authors: | Ou, Lizhen1 (AUTHOR), Yao, Yiping1 (AUTHOR), Luo, Xueshan1 (AUTHOR), Li, Xinmeng1 (AUTHOR), Chen, Kai1 (AUTHOR) |
| Source: | International Journal of Intelligent Systems. 7/29/2023, p1-14. 14p. |
| Subjects: | Language models, Acronyms, Natural language processing |
| Abstract: | Acronym disambiguation is the process of determining the correct expansion of an acronym in given context, which can assist many downstream natural language processing tasks. Typically, existing methods on this task will directly perform semantic comparisons between the candidate expansions and the original sentence, ignoring the relevance of contextual information to expansions. To solve this issue, this paper proposes a context-aware acronym disambiguation method with Siamese BERT network (ContextAD). First, we combine each candidate expansion with corresponding acronym's context to form a new sentence set. Then, the new and original sentences are input into a Siamese BERT network that can obtain the semantic similarity. The new sentences and the separate candidate expansions are input into the Siamese BERT network, respectively, along with the original sentences, which can obtain another semantic similarity. Finally, the two different semantic similarities are combined to determine the most suitable expansion. We quantify the improvement of our proposed ContextAD model against a state-of-the-art baseline using the public dataset of the shared tasks of acronym disambiguation (AD) held under AAAI-2021 workshop on SDU and show that it achieves a better performance based on the same BERT model. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Intelligent Systems is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Acronym disambiguation is the process of determining the correct expansion of an acronym in given context, which can assist many downstream natural language processing tasks. Typically, existing methods on this task will directly perform semantic comparisons between the candidate expansions and the original sentence, ignoring the relevance of contextual information to expansions. To solve this issue, this paper proposes a context-aware acronym disambiguation method with Siamese BERT network (ContextAD). First, we combine each candidate expansion with corresponding acronym's context to form a new sentence set. Then, the new and original sentences are input into a Siamese BERT network that can obtain the semantic similarity. The new sentences and the separate candidate expansions are input into the Siamese BERT network, respectively, along with the original sentences, which can obtain another semantic similarity. Finally, the two different semantic similarities are combined to determine the most suitable expansion. We quantify the improvement of our proposed ContextAD model against a state-of-the-art baseline using the public dataset of the shared tasks of acronym disambiguation (AD) held under AAAI-2021 workshop on SDU and show that it achieves a better performance based on the same BERT model. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 08848173 |
| DOI: | 10.1155/2023/5014355 |
