Skip to content
View original post on X: Dongxi NLP
Published
18/100

Dongxi NLP explains LoRA and QLoRA through rank, low-rank approximation, and quantization

AIDongxi NLP publishes the third post in its post-training series, covering LoRA and QLoRA. The post defines three core concepts, rank, low-rank approximation, and quantization, and links them through the idea of patterns in matrices.
Dongxi NLPVerified on X
@dongxi_nlp
View on X

后训练文章系列第三篇,关于 LoRA 和 QLoRA

三个重要的基本概念:

rank 秩
low-rank approximation 低秩近似
quantization 量化

它们可以用同一个概念串起来,即矩阵中的 pattern模式。

Dongxi 东锡 NLP@dongxi_nlp
https://x.com/i/article/2113912265061593088
View quoted post on X
Source details

Dongxi NLP · x.comPublished · added here

Original title: 后训练文章系列第三篇,关于 LoRA 和 QLoRA