I wonder how to merge my PEFT adapter with the base model and finally get a new whole model?

[John6666]

It seems that the problem can be avoided in some cases by using the PEFT side function.

'MistralForCausalLM' object has no attribute 'merge_and_unload"

Help with merging LoRA weights back into base model

As best as I can tell, the LoraModel merge_and_unload attribute (peft/lora.py at main · huggingface/peft · GitHub) merges LoRA weights back into the main model. However, I am having trouble getting a LoraModel type from my PeftModelForCausalLM. My current workflow is to define a pretrained model, define a LoraConfig, and use the get_peft_model function to being training. This works great, but I want to be able to merge the weights back into the base model and save. My working assumption is tha…