Remember scalability? We've just created an AI inference engine that scales, and we open-sourced it.
Finally AI running on Apple Silicon not only competes with DGX Sparks, it leaves them in the dust - for now.
Incept5 AI open-sources inferd, an inference engine for Apple Silicon
AIIncept5 AI says it has built and open-sourced inferd, an AI inference engine that scales. The post claims it runs AI on Apple Silicon and outperforms DGX Spark systems, though no benchmark figures are given.
Source details
John T Davies 🇪🇺 · x.comPublished · added here
Original title: Remember scalability? We've just created an AI inference engine that scales, and we open-sourced it.