Our recipe for mid-training and post-training on FineDNA is fully open and we hope these lessons on breaking past the distillation ceiling help model builders do the same in new domains!
Dataset ⬇️
Hugging Face open-sources FineDNA mid- and post-training recipe
AIHugging Face says its mid-training and post-training recipe for the FineDNA dataset is fully open, aiming to help model builders break past the distillation ceiling in new domains. The post links the FineDNA dataset on Hugging Face.
Source details
Lewis Tunstall · x.comPublished
Original title: Our recipe for mid-training and post-training on FineDNA is fully open and we hope these lessons on breaking past the distillation ceilin...