The original title is "null" so I need to create a headline from the summary. The key facts are:

Short summary

This paper proves mathematically that low-rank decomposition and quantization are non-orthogonal, meaning their combination introduces errors beyond those each method independently produces. The authors validate this experimentally and propose the Diagonal Adhesive Method (DAM) to effectively combine both compression techniques while mitigating performance degradation. The work provides theoretical and experimental foundations for future LLM compression research.

• •First mathematical proof that low-rank decomposition and quantization are non-orthogonal, not independent
• •Combining both methods causes significant performance degradation beyond individual errors
• •Proposes Diagonal Adhesive Method (DAM) to mitigate loss when combining compression techniques

Generated with AI, which can make mistakes.