The need for computing power for artificial intelligence startups has not shown any signs of slowing down. Now, there’s a new GPU from Nvidia that might change the game.

‍What’s happening:‍

• Nvidia (NASDAQ: NVDA) has unveiled their new superchip for AI workloads, the HGX H200 GPU
  
• The new hardware offers both faster memory and doubles the inference speed on large language model training
  

Why it matters:‍

• From GPUs to NPUs, artificial intelligence startups are all searching for computing power to build generative AI and power their workloads
  
• There continues to be a massive shortage of GPU cloud computing access which makes the launch of Nvidia’s new chip even more relevant
  

Going deeper:‍

• The H200 GPU will greatly enhance image and speech recognition in AI models
  
• Cloud computing providers including Amazon, Google and Oracle will be amongst some of the first companies to roll out the H200
  

By the numbers:‍

• The H200 GPU has 141 gigabytes of memory
  
• Nvidia has stated the H200 is capable of a 60-90% performance improvement for AI workloads when compared to their H100 GPU
  

Market reaction:‍

• Shares of Nvidia are up +5% since the announcement of the H200 roll out