I find the "inception" pattern to be very useful in many agentic use cases. You can force the model to take an action when it thinks for too long by injecting a thought after a specified reasoning budget. Helps dealing with underspecified tasks which make the model reason for way too long.
I find the "inception" pattern to be very useful in many agentic use cases. You can force the model to take an action when it thinks for too long by injecting a thought after a specified reasoning budget.
Helps dealing with underspecified tasks which make the model reason for way too long.
to limit the max reasoning length, add: ... \ --reasoning-budget 4096 \ --reasoning-budget-message "... I am thinking for too -- let me gather more info about the task." adjust to your needsView quoted post on X
Source: Georgi Gerganov · x.comPublished · added here
