[Submitted on 4 Jun 2023 ( v1 ), last revised 24 Jan 2024 (this version, v4)] Title:OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models Download a PDF of the paper titled OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models, by Changhun Lee and 4 other authors Download PDF HTML (experimental) Abstract:Large language models (LLMs) with hundreds of billions of parameters require powerful...
