Fine-tuning GPT-OSS-20B for multilingual reasoning on Amazon SageMaker HyperPod
AIAWS shows that supervised fine-tuning lifts GPT-OSS-20B's reasoning in the target language, while GRPO adds gains only where the base model already sometimes produces the desired behavior. On a 50-example multilingual test, the base model reasoned in the requested language only 22 percent of the time, with English at 100 percent and French, Spanish and Italian at 0 percent.
Source details
AWS Machine Learning Blog · Mijanur Palash · aws.amazon.comPublished