首页|期刊导航|Visual Intelligence|An empirical study of LLaMA3 quantization:from LLMs to MLLMs

An empirical study of LLaMA3 quantization:from LLMs to MLLMs

Wei Huang Xingyu Zheng Xudong Ma Haotong Qin Chengtao Lv Hong Chen Jie Luo Xiaojuan Qi Xianglong Liu Michele Magno

Visual Intelligence2024，Vol.2Issue(1)：P.457-469,13.

Visual Intelligence2024，Vol.2Issue(1)：P.457-469,13.DOI:10.1007/s44267-024-00070-x

An empirical study of LLaMA3 quantization:from LLMs to MLLMs

Wei Huang ¹Xingyu Zheng ²Xudong Ma ²Haotong Qin ³Chengtao Lv ²Hong Chen ²Jie Luo ²Xiaojuan Qi ¹Xianglong Liu ²Michele Magno³

作者信息

1. Department of Electrical and Electronic Engineering,The University of Hong Kong,Pokfulam Road,Hong Kong,999077,China
2. School of Computer Science and Engineering,Beihang University,Xueyuan Road,Beijing,100191,China
3. Department of Information Technology and Electrical Engineering,ETH Zurich,Sternwartstrasse 7,Zürich,Switzerland
折叠

摘要

关键词

Model quantization/Large language model/Multi-modal/Deep learning

分类

信息技术与安全科学

引用本文复制引用

Wei Huang,Xingyu Zheng,Xudong Ma,Haotong Qin,Chengtao Lv,Hong Chen,Jie Luo,Xiaojuan Qi,Xianglong Liu,Michele Magno..An empirical study of LLaMA3 quantization:from LLMs to MLLMs[J].Visual Intelligence,2024,2(1):P.457-469,13.

基金项目

supported by the National Science and Technology Major Project(2021ZD0110503) （2021ZD0110503）

the Swiss National Science Foundation(SNSF)project 200021E_219943 Neuromorphic Attention Models for Event Data(NAMED) （SNSF）

the Baidu Scholarship,and the National Natural Science Foundation of China(Nos.62306025 and 92367204). （Nos.62306025 and 92367204）

Visual Intelligence

ISSN：2097-3330

访问量0

下载量0

段落导航