OpenAI and Broadcom Unveil Jalapeño, a Custom LLM Inference Chip

OpenAI and Broadcom have introduced Jalapeño, a custom AI chip built for LLM inference, targeting better performance, efficiency and scale across AI systems as inference costs shape AI economics.