Google, Intel, and Nvidia Engage in Fierce Competition in Generative AI Training

Recently, MLPerf has added tests for training large language models and generating images based on text. Nvidia, Intel, and Google have all invested in large systems to participate in the new benchmark tests. Nvidia's 10,000 GPU system completed GPT-3 training in the shortest time. Intel's Gaudi 2 has significantly improved its 8-bit floating-point computing performance but still lags behind Nvidia's system. Nvidia and Microsoft's systems based on tens of thousands of GPUs are engaged in fierce competition for GPT-3 training. Training generative AI systems requires immense computing power, and companies are competing vigorously.