Sony patent describes AI predicting game frames before GPU rendering finishes

Sony has filed a patent for an AI system that predicts the next game frame before the GPU finishes rendering it, to reduce stutter without the added latency of frame generation, according to TechSpot as cited by IT Home.

The system uses a jointly trained codec to convert rendered frames into compact embeddings and runs in parallel with the graphics pipeline. Frame generation inserts intermediate frames between two completed frames, so the display must wait for both; the patent's approach aims to avoid that wait.

Whether the approach works in practice depends on whether the AI can produce accurate frames quickly enough to fill output gaps when rendering slows, according to the report. A filed patent does not show that Sony has built or shipped the system.