Skip to content

Forem

# quantization

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Arvind SundaraRajan

Nov 11

Unleash AI on Tiny Hardware: Quantization for Embedded Reinforcement Learning by Arvind Sundararajan

#machinelearning #embedded #ai #quantization

2 min read

Cover image for Fine-Tuning LLMs: LoRA, Quantization, and Distillation Simplified

Syed Mohammed Faham

Nov 15

Fine-Tuning LLMs: LoRA, Quantization, and Distillation Simplified

#llm #finetuning #ai #quantization

5 min read

Arvind SundaraRajan

Oct 30

Squeezing AI into Tiny Spaces: The Integer Revolution

#machinelearning #deeplearning #quantization #optimization

2 min read

Cover image for How to Calculate Perplexity (PPL) the Right Way (and Avoid Common Pitfalls)

Edson

Aug 2

How to Calculate Perplexity (PPL) the Right Way (and Avoid Common Pitfalls)

#llm #ai #quantization

2 min read

Cover image for Extended RaBitQ: an Optimized Scalar Quantization Method

Dec 12 '24

Extended RaBitQ: an Optimized Scalar Quantization Method

#rabitq #vectordatabase #quantization #rag

7 min read

Cover image for Quantization in The Counterintuitive High-Dimensional Space

Dec 8 '24

Quantization in The Counterintuitive High-Dimensional Space

#vectordatabase #rag #quantization #rabitq

11 min read

Cover image for Understanding Quantization in AI: A Comprehensive Guide Including LoRA and QLoRA

Jack Rover

May 26 '24

Understanding Quantization in AI: A Comprehensive Guide Including LoRA and QLoRA

#quantization #ai

3 min read

loading...