As the AI infrastructure market evolves, we’ve been hearing a lot more about AI inference—the last step in the AI technology infrastructure chain to deliver fine-tuned answers to the prompts given to ...
Jim Fan is one of Nvidia’s senior AI researchers. The shift could be about many orders of magnitude more compute and energy needed for inference that can handle the improved reasoning in the OpenAI ...