Ai2 releases new Stage 1 checkpoints with byte-level components pretrained
AIAi2 is making new Stage 1 checkpoints available, with the byte-level components already trained and the original model's weights left unchanged. Researchers can use them to test new architectures and train the full system without repeating that initial stage.