Use --reasoning-budget 0 for instruct mode
#5
by vico44 - opened
In the guide it is written:
To disable thinking / reasoning, use --chat-template-kwargs "{"enable_thinking": false}"
Well i have experienced with it and i get weird outputs on some tasks... Setting reasoning budget to zero actually works pretty well (--reasoning-budget 0).
++
Early tests look good. Thank you so much vico44!
I do both to turn off reasoning in most models.
This comment has been hidden (marked as Resolved)