Abstract: The Transformer architecture, despite its scaling law, faces expensive computational cost challenges as the number of parameters increases. Quantization methods like Ternary-BERT and BitNet ...

Abstract: Factorizing a low-rank matrix into two matrix factors with low dimensions from its noisy observations is a classical but challenging problem arising from real-world applications. This paper ...