Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization.

Saved in:
Bibliographic Details
Title: Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization.
Authors: Burger, Martin1,2 (AUTHOR) martin.burger@desy.de, Kabri, Samira1 (AUTHOR) samira.kabri@desy.de, Korolev, Yury3 (AUTHOR) ymk30@bath.ac.uk, Roith, Tim1 (AUTHOR) tim.roith@desy.de, Weigand, Lukas1 (AUTHOR) lukas.weigand@desy.de
Source: Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences. 6/5/2025, Vol. 383 Issue 2298, p1-48. 48p.
Database: Academic Search Ultimate
FullText Text:
  Availability: 0
Header DbId: asn
DbLabel: Academic Search Ultimate
An: 185742827
AccessLevel: 2
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Burger%2C+Martin%22">Burger, Martin</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> martin.burger@desy.de</i><br /><searchLink fieldCode="AR" term="%22Kabri%2C+Samira%22">Kabri, Samira</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> samira.kabri@desy.de</i><br /><searchLink fieldCode="AR" term="%22Korolev%2C+Yury%22">Korolev, Yury</searchLink><relatesTo>3</relatesTo> (AUTHOR)<i> ymk30@bath.ac.uk</i><br /><searchLink fieldCode="AR" term="%22Roith%2C+Tim%22">Roith, Tim</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> tim.roith@desy.de</i><br /><searchLink fieldCode="AR" term="%22Weigand%2C+Lukas%22">Weigand, Lukas</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> lukas.weigand@desy.de</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Philosophical+Transactions+of+the+Royal+Society+A%3A+Mathematical%2C+Physical+%26+Engineering+Sciences%22">Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences</searchLink>. 6/5/2025, Vol. 383 Issue 2298, p1-48. 48p.
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=185742827
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1098/rsta.2024.0233
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 48
        StartPage: 1
    Titles:
      – TitleFull: Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Burger, Martin
      – PersonEntity:
          Name:
            NameFull: Kabri, Samira
      – PersonEntity:
          Name:
            NameFull: Korolev, Yury
      – PersonEntity:
          Name:
            NameFull: Roith, Tim
      – PersonEntity:
          Name:
            NameFull: Weigand, Lukas
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 05
              M: 06
              Text: 6/5/2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 1364503X
          Numbering:
            – Type: volume
              Value: 383
            – Type: issue
              Value: 2298
          Titles:
            – TitleFull: Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences
              Type: main
ResultId 1