And this is just a 14B model. Should we scale the recipe to 100B+ parameters?
Lewis Tunstall asks whether to scale Carbon-X's 14B recipe to 100B+ parameters
AILewis Tunstall of Hugging Face asks whether the recipe behind the 14B-parameter Carbon-X model should be scaled to 100B+ parameters. The post builds on a Hugging Face Bio announcement describing Carbon-X as fluent in English and DNA, and the model is available on Hugging Face.
Lewis TunstallVerified on X
@_lewtun
Carbon-X is the first model achieving frontier intelligence on DNA understanding! It is fluent in both English and DNA so you can chat to DNA! Biology and DNA understanding will have a huge impact and be the main focus of the frontier labs. Model: https://huggingface.co/HuggingFaceBio/Carbon-X
Source details
Lewis Tunstall · x.comPublished · added here
Original title: And this is just a 14B model. Should we scale the recipe to 100B+ parameters?