# Shanghai Jiao Tong's Yan Junchi outlines JTok and xHC Transformer extensions at CNCC 2026

> Original title: Transformer 架构还能咋改？严骏驰团队提供两条思路 | CNCC 2026

- Source: Leiphone
- Published: 2026-11-04T07:48:00.000Z
- Bad Influence: https://badinfluence.news/items/vffi0dpqv9tdj8p7nxfimr4ea
- Original: https://www.leiphone.com/category/private/qWW7SeepMBzAQAfb.html

## Summary

Shanghai Jiao Tong University professor Yan Junchi presented two Transformer extensions at CNCC 2026: JTok, which adds learnable per-token parameter tables, and xHC, which expands the residual stream to 16 paths with dense reads and sparse writes. In his experiments, JTok-M cuts training compute by about 35% to reach the same loss but adds about 7% inference latency, while xHC saves about 33% versus a standard Transformer and about 16% versus mHC.