Advertisement
Artificial intelligence
TechTech Trends

Chinese AI can benefit from bigger models, more data, says start-up founder

  • The founder of Stepfun, which develops foundational models, has set its sights on improving multimodal models as China faces curtailed access to advanced chips

Reading Time:2 minutes
Why you can trust SCMP
People walk by signage for the World Artificial Intelligence Conference in Shanghai on July 3, 2024. Photo: AP
Wency Chenin Shanghai
The founder of a Shanghai-based artificial intelligence (AI) start-up is putting his faith in the “scaling laws” of large language model (LLM) development, despite China’s disadvantages in investment and advanced chips.

Jiang Daxin, a Microsoft veteran who founded and now runs Stepfun, said at a side event for the World Artificial Intelligence Conference (WAIC) in Shanghai that LLMs will eventually reach hundreds of trillions of parameters.

Scaling laws seek to measure the relationship between AI model performance and their parameters. They generally show improved performance from larger models, more data, and greater computational resources, but with diminishing returns. Tech giants have been splurging on the most advanced tech – most notably Nvidia chips like the H100s – to eke out any possible edge in performance.
Advertisement

“The upgrades of OpenAI’s GPT series, which powers ChatGPT, along with the substantial investments in supercomputing centres by tech giants such as Amazon, Microsoft and Meta, all validate the effectiveness of scaling laws,” Jiang said in a talk on Saturday. “Going forward, issues like the availability of data, human resources, and concerns about return on investment may impact the pace of scaling laws.”

02:12

Inside a Chinese factory that makes humanoid robots with enhanced facial movements

Inside a Chinese factory that makes humanoid robots with enhanced facial movements
China’s Big Tech firms and start-ups alike have rushed to launch their own LLMs since OpenAI launched ChatGPT in late 2022. There are more than 200 AI models in the country, including Tongyi Qianwen by Alibaba Group Holding and Ernie by internet search giant Baidu. Alibaba owns the South China Morning Post.
Advertisement

Yet few Chinese AI firms have so far been able to match US tech giants in LLM spending, and many have sought to develop client-facing applications that can generate revenue.

Advertisement
Select Voice
Choose your listening speed
Get through articles 2x faster
1.25x
250 WPM
Slow
Average
Fast
1.25x