Hello, I ran your llama_seq_clf.py file, where I handwritten the inference function and loaded it with the best checkpoint in 10 echoes, resulted in a lower accuracy than directly using trainer.predict in llama_seq_clf.py. I am sure that there is no problem with merged models in my inference function, but I don't know exactly why.
Hello, I ran your llama_seq_clf.py file, where I handwritten the inference function and loaded it with the best checkpoint in 10 echoes, resulted in a lower accuracy than directly using trainer.predict in llama_seq_clf.py. I am sure that there is no problem with merged models in my inference function, but I don't know exactly why.