Databricks cuts Qwen 3.8 27B fine-tuning time from 7h44m to 1h17m
Original titleReducing Qwen training time by 6x on AI Runtime
AISummary
Databricks reports cutting fine-tuning time for Qwen 3.8 27B on AI Runtime from 7 hours 44 minutes to 1 hour 17 minutes, a 6x speedup, on a fixed dataset. The gains came from installing fused flash-linear-attention and causal-conv1d kernels, which cut the training time to 2 hours 5 minutes, and from packing 1D batches with position_ids, which cut it further to 1 hour 17 minutes.
AIWhy it matters
The post breaks down each step that cut Qwen 3.8 27B fine-tuning time from 7h44m to 1h17m, showing which optimizations transfer to other training jobs.
Source: Databricks Blog · databricks.comPublished · added here