Making LLMs lighter with AutoGPTQ and transformers

More Articles from our Blog

[

llmoptimizationquantization

Overview of natively supported quantization schemes in 🤗 Transformers

• 
• 
• 
• 
• +1

13

September 12, 2023

](https://huggingface.co/blog/overview-quantization-transformers)

[

sftoptimizationllm

Make LLM Fine-tuning 2x faster with Unsloth and 🤗 TRL

• 

77

January 10, 2024

](https://huggingface.co/blog/unsloth-trl)

Community

EditPreview

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Comment

· Sign up or log in to comment

[Upvote

64](https://huggingface.co/login?next=%2Fblog%2Fgptq-integration)

• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• +52