OpenAI and Broadcom unveil Jalapeño, an LLM-optimized inference chip developed from design to manufacturing tape-out in nine months, aided by OpenAI's models (OpenAI)
OpenAI and Broadcom disclosed a custom LLM inference chip, signaling deeper vertical integration around AI compute supply.
Excerpt
<a href="https://openai.com/index/openai-broadcom-jalapeno-inference-chip"><img align="RIGHT" border="0" hspace="4" src="http://www.techmeme.com/260624/i22.jpg" vspace="4" /></a>
<p><a href="https://www.techmeme.com/260624/p22#a260624p22" title="Techmeme permalink"><img height="12" src="http://www.techmeme.com/img/pml.png" style="border: none; padding: 0; margin: 0;" width="11" /></a> <a href="https://openai.com/">OpenAI</a>:<br />
<span style="font-size: 1.3em;"><b><a href="https://openai.com/index/openai-broadcom-jalapeno-inference-chip">OpenAI and Broadcom unveil Jalapeño, an LLM-optimized inference chip developed from design to manufacturing tape-out in nine months, aided by OpenAI's models</a></b></span> — Loading... - Early testing shows that the first-generation accelerator will deliver performance per watt substantially better than current state-of-the-art</p>
Read at source: https://www.techmeme.com/260624/p22#a260624p22