View in EDS HTML Full Text PDF Full Text

CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction.

Saved in:
Bibliographic Details
Title: CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction.
Authors: Peng, Kun1 (AUTHOR), Li, Shanke1 (AUTHOR), Hui, Fei2 (AUTHOR) feihui@chd.edu.cn, Liu, Xiyao2 (AUTHOR) liuxiyao@chd.edu.cn, Shriniwas, Arkatkar (AUTHOR) sarkatkar@ced.svnit.ac.in
Source: Journal of Advanced Transportation. 5/13/2026, Vol. 2026, p1-14. 14p.
Subjects: Contrastive learning, Motion analysis, Image retrieval, Acquisition of data, Autonomous vehicles
Abstract: Extracting critical scenarios from the vast and complex driving environments is a crucial step in the iterative upgrade process of autonomous driving systems. Existing image–text‐based retrieval methods provide a good understanding of the environment but overlook the critical information regarding the impact of the environment on the self‐vehicle. To address these issues, we propose a contrastive image–text–motion retrieval (CITMR) cross‐modal learning framework that uses descriptive text as input to retrieve critical scenarios. The framework employs image, text, and motion encoders to extract features from different modalities and uses contrastive loss to enable cross‐modal information comparison and interaction. Finally, the vehicle's motion and its textual description are supplemented in the collected autonomous driving dataset, and a scenario dataset containing image–text–motion pairs is constructed for model validation. Experimental results show that CITMR achieves retrieval performance for text‐critical scenarios of 0.8684 and 0.8557 on two test datasets, outperforming the baseline methods. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Advanced Transportation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 193710431
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Peng%2C+Kun%22">Peng, Kun</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Li%2C+Shanke%22">Li, Shanke</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Hui%2C+Fei%22">Hui, Fei</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> feihui@chd.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Liu%2C+Xiyao%22">Liu, Xiyao</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> liuxiyao@chd.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Shriniwas%2C+Arkatkar%22">Shriniwas, Arkatkar</searchLink> (AUTHOR)<i> sarkatkar@ced.svnit.ac.in</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Advanced+Transportation%22">Journal of Advanced Transportation</searchLink>. 5/13/2026, Vol. 2026, p1-14. 14p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Contrastive+learning%22">Contrastive learning</searchLink><br /><searchLink fieldCode="DE" term="%22Motion+analysis%22">Motion analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Image+retrieval%22">Image retrieval</searchLink><br /><searchLink fieldCode="DE" term="%22Acquisition+of+data%22">Acquisition of data</searchLink><br /><searchLink fieldCode="DE" term="%22Autonomous+vehicles%22">Autonomous vehicles</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Extracting critical scenarios from the vast and complex driving environments is a crucial step in the iterative upgrade process of autonomous driving systems. Existing image–text‐based retrieval methods provide a good understanding of the environment but overlook the critical information regarding the impact of the environment on the self‐vehicle. To address these issues, we propose a contrastive image–text–motion retrieval (CITMR) cross‐modal learning framework that uses descriptive text as input to retrieve critical scenarios. The framework employs image, text, and motion encoders to extract features from different modalities and uses contrastive loss to enable cross‐modal information comparison and interaction. Finally, the vehicle's motion and its textual description are supplemented in the collected autonomous driving dataset, and a scenario dataset containing image–text–motion pairs is constructed for model validation. Experimental results show that CITMR achieves retrieval performance for text‐critical scenarios of 0.8684 and 0.8557 on two test datasets, outperforming the baseline methods. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Advanced Transportation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=193710431
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1155/atr/4985228
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 1
    Subjects:
      – SubjectFull: Contrastive learning
        Type: general
      – SubjectFull: Motion analysis
        Type: general
      – SubjectFull: Image retrieval
        Type: general
      – SubjectFull: Acquisition of data
        Type: general
      – SubjectFull: Autonomous vehicles
        Type: general
    Titles:
      – TitleFull: CITMR: Contrastive Image–Text–Motion Retrieval for Autonomous Driving Critical Scenarios Extraction.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Peng, Kun
      – PersonEntity:
          Name:
            NameFull: Li, Shanke
      – PersonEntity:
          Name:
            NameFull: Hui, Fei
      – PersonEntity:
          Name:
            NameFull: Liu, Xiyao
      – PersonEntity:
          Name:
            NameFull: Shriniwas, Arkatkar
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 13
              M: 05
              Text: 5/13/2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 01976729
          Numbering:
            – Type: volume
              Value: 2026
          Titles:
            – TitleFull: Journal of Advanced Transportation
              Type: main
ResultId 1