View in EDS PDF Full Text

FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference.

Saved in:
Bibliographic Details
Title: FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference.
Authors: Lin, Chenqi1, Xu, Tianshi1, Yang, Zebin1, Wang, Runsheng1,2,3, Huang, Ru2,3, Li, Meng1,2,4, meng.li@pku.edu.cn
Source: DAC: Annual ACM/IEEE Design Automation Conference; 2024, Issue 61, p1514-1519, 6p
Database: Applied Science & Technology Source
Description
ISSN:0738100X
DOI:10.1145/3649329.3657374