BLOOMZ and mT0 models are related, and mT0-13B performs better than BLOOMZ-176B in some cases. The mT0-13B will be a killer model for normal user devices after a GPTQ-4bit quantization. Hope the model can be supported.
BLOOMZ and mT0 models are related, and mT0-13B performs better than BLOOMZ-176B in some cases.
The mT0-13B will be a killer model for normal user devices after a GPTQ-4bit quantization.
Hope the model can be supported.