INT4 LoRA fine-tuning vs QLoRA: A user inquired about the variations amongst INT4 LoRA wonderful-tuning and QLoRA in terms of precision and speed. A further member explained that QLoRA with HQQ entails frozen quantized weights, isn't going to use tinnygemm, and utilizes dequantizing alongside torch.matmul The open-resource IC-Mild venture ce