Amazon shows how to distill a shopping agent with SeqKD on SageMaker AI
AIAWS Machine Learning Blog explains sequence-level knowledge distillation (SeqKD), which fine-tunes a smaller student model on a frontier teacher's text outputs and needs no teacher weights or logits. The post applies it to a shopping agent on Amazon SageMaker AI, covering trajectory generation, supervised fine-tuning, serverless training, and evaluation against a held-out benchmark.
Source details
AWS Machine Learning Blog · Giuseppe Zappia · aws.amazon.comPublished · added here
Original title: Build efficient agents with knowledge distillation on Amazon SageMaker AI