🚀 Infer-forge: Harness, Loop, and Graph Engineering Around SGLang
@ant_oss built a three-layer system for running long inference optimization work through agents without losing provenance: Harness for execution, Task Loop for one Task's contract, Task Graph for verified Handoffs.
Highlights:
- Peak Tasks in flight rose from 2 to 9, median Task lifetime from 10h to 28h
- The agent ran a full serving project on DeepSeek-V4-Pro by itself. Splitting the work into 38 pieces and verifying each one like a human engineer.
- The harness catches kernel silent corruption on its own.
Read the full blog below 👇