OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show

OpenAI's Jalapeño chip performed above current benchmarks in inference speed and energy efficiency tests. According to Semianalysis's InferenceX benchmark, the chip produced more tokens per user and more throughput per kilowatt than existing alternatives measured by that test.

Next story