Baidu Claims Its Ernie Bot Now Beats ChatGPT on Key Measures

Baidu Inc.’s ChatGPT-style service has outperformed OpenAI’s seminal product on several measures, China’s search leader said on Tuesday.

Ernie 3.5, the latest iteration of Baidu’s foundation model, has surpassed OpenAI’s chatbot built on GPT-3.5 in general abilities and outperformed the more advanced GPT-4 on several Chinese-language capabilities, the company said in a statement. It cited a test by the state newspaper China Science Daily, based on datasets including AGIEval and C-Eval, benchmarks designed for evaluating such AI models.

Baidu’s new model also boosted its training and inference efficiency, making it faster and cheaper to iterate and upgrade ...