Overview of natively supported quantization schemes in 🤗 Transformers

More Articles from our Blog

[

llmoptimizationquantization

Making LLMs lighter with AutoGPTQ and transformers

• 
• 
• 
• 
• +2

64

August 23, 2023

](https://huggingface.co/blog/gptq-integration)

[

sftoptimizationllm

Make LLM Fine-tuning 2x faster with Unsloth and 🤗 TRL

• 

77

January 10, 2024

](https://huggingface.co/blog/unsloth-trl)

Community

EditPreview

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Comment

· Sign up or log in to comment

[Upvote

13](https://huggingface.co/login?next=%2Fblog%2Foverview-quantization-transformers)

• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• +1