Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization.
Saved in:
| Title: | Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization. |
|---|---|
| Authors: | Burger, Martin1,2 (AUTHOR) martin.burger@desy.de, Kabri, Samira1 (AUTHOR) samira.kabri@desy.de, Korolev, Yury3 (AUTHOR) ymk30@bath.ac.uk, Roith, Tim1 (AUTHOR) tim.roith@desy.de, Weigand, Lukas1 (AUTHOR) lukas.weigand@desy.de |
| Source: | Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences. 6/5/2025, Vol. 383 Issue 2298, p1-48. 48p. |
| Database: | Academic Search Ultimate |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: asn DbLabel: Academic Search Ultimate An: 185742827 AccessLevel: 2 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Burger%2C+Martin%22">Burger, Martin</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> martin.burger@desy.de</i><br /><searchLink fieldCode="AR" term="%22Kabri%2C+Samira%22">Kabri, Samira</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> samira.kabri@desy.de</i><br /><searchLink fieldCode="AR" term="%22Korolev%2C+Yury%22">Korolev, Yury</searchLink><relatesTo>3</relatesTo> (AUTHOR)<i> ymk30@bath.ac.uk</i><br /><searchLink fieldCode="AR" term="%22Roith%2C+Tim%22">Roith, Tim</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> tim.roith@desy.de</i><br /><searchLink fieldCode="AR" term="%22Weigand%2C+Lukas%22">Weigand, Lukas</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> lukas.weigand@desy.de</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Philosophical+Transactions+of+the+Royal+Society+A%3A+Mathematical%2C+Physical+%26+Engineering+Sciences%22">Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences</searchLink>. 6/5/2025, Vol. 383 Issue 2298, p1-48. 48p. |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=185742827 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1098/rsta.2024.0233 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 48 StartPage: 1 Titles: – TitleFull: Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Burger, Martin – PersonEntity: Name: NameFull: Kabri, Samira – PersonEntity: Name: NameFull: Korolev, Yury – PersonEntity: Name: NameFull: Roith, Tim – PersonEntity: Name: NameFull: Weigand, Lukas IsPartOfRelationships: – BibEntity: Dates: – D: 05 M: 06 Text: 6/5/2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 1364503X Numbering: – Type: volume Value: 383 – Type: issue Value: 2298 Titles: – TitleFull: Philosophical Transactions of the Royal Society A: Mathematical, Physical & Engineering Sciences Type: main |
| ResultId | 1 |