Better aligned models obtained by model extrapolation (ExPO)
-
Weak-to-Strong Extrapolation Expedites Alignment
Paper • 2404.16792 • Published • 11 -
chujiezheng/Mistral7B-PairRM-SPPO-ExPO
Text Generation • 7B • Updated • 7.51k • -
chujiezheng/LLaMA3-iterative-DPO-final-ExPO
Text Generation • 8B • Updated • 7.57k • • 2 -
chujiezheng/Llama3-8B-Chinese-Chat-ExPO
Text Generation • 8B • Updated • 7.58k • • 1
