Ant Group Innovatively Harnesses Huawei Chips to Achieve Cost-Effective AI Models Comparable to Meta’s Llama

NVIDIA, a major player in the AI market, may soon face significant competition in China as Ant Group, backed by tech mogul Jack Ma, has reportedly developed advanced AI models using cost-effective Chinese chips.

China’s AI sector is undergoing a remarkable transformation, largely fueled by the country’s drive to become self-sufficient in technology amidst US export restrictions. Domestic companies, particularly Huawei, have risen to the challenge, stepping in to support the local market. These homegrown efforts appear to be shaking up the AI landscape that NVIDIA once dominated. Bloomberg reports that Ant Group, primarily a financial technology company, has created AI models that surpass those of giants like Meta, utilizing chips manufactured by Huawei.

According to the report, Ant Group introduced AI models named “Ling-Lite and Ling-Plus” at prices 20% below the industry average. This milestone is not solely due to the use of Chinese chips; Ant Group has also developed innovative AI training techniques that boost model efficiency significantly. They capitalized on chips from Huawei and harnessed their own in-house technologies to power these advancements. Ant Group employed a method called the “Mixture of Experts,” which is designed to enhance both the effectiveness and scalability of massive models.

These in-house creations reportedly match NVIDIA’s H800 AI GPUs in terms of performance, with some Ant Group models even surpassing Meta in specific tests. However, these results are based on internal evaluations, and their broader applicability remains to be seen. Impressively, Ant Group achieved the feat of training one trillion tokens at a cost of 5.1 million yuan, which is roughly 20% less than what other standard methods yield.

While Ant Group has not yet revealed if these models will be publicly accessible, their progress signifies a pivotal shift for China. The country appears to be paving its own path, challenging the prevailing notion from the West that AI development demands enormous financial resources. This evolution highlights China’s growing capability and ambition in the global tech arena.