Is it possible for Baidu's AI chatbot, Ernie, to exceed the performance of OpenAI's ChatGPT?

In Brief

According to Baidu, its service resembling ChatGPT has shown superior performance across multiple dimensions compared to OpenAI's chatbot.

The new AI iteration from Baidu, known as Ernie 3.5, has not only bested ChatGPT (GPT-3.5) in terms of overall capabilities but has also outperformed GPT-4 in tests conducted in the Chinese language.

Haifeng Wang, the CTO of Baidu, emphasized the significant advancements in the effectiveness, versatility, and overall performance of Ernie 3.5, particularly in areas like creative writing, question-and-answer sessions, logical reasoning, as well as code generation and training accuracy.

Baidu, a major player among China's search engines, announced asserted that its AI service designed in the likeness of ChatGPT has excelled over OpenAI's offering in various aspects. The company noted that its latest AI model, Ernie 3.5, has outshined ChatGPT (GPT-3.5) in terms of ability scores and performed better than GPT-4 on Chinese language evaluations.

One of the evaluation tests for Ernie 3.5 was modeled on standardized college entrance exams or professional qualification tests, including those for law. In results published by Microsoft, Ernie 3.5 surpassed both ChatGPT and GPT-4 in Chinese language assessments but was outpaced by GPT-4 when it came to English, even though it still performed better than ChatGPT.

Another evaluation involved over 13,000 multiple-choice questions across more than 50 fields, culminating in Ernie 3.5 scoring higher than both ChatGPT and GPT-4.

In a separate test designed by American universities that included diverse queries from sciences and humanities, Ernie 3.5 did fall short compared to both ChatGPT and GPT-4.

Haifeng Wang, Baidu's CTO, stated:

“Just three months following the beta introduction of Ernie Bot, which is based on the previous Ernie 3.0, our latest model, Ernie 3.5, has exhibited substantial improvements in operational effectiveness, variety of functions, and performance metrics across different tasks. These enhancements are clear in creative writing, Q&A formats, logical reasoning, and code development, alongside training and inference capabilities.”

As claimed by Baidu, the newly developed model has made strides in optimization for both training and inference, allowing for faster and more efficient updates. Furthermore, Baidu indicated announced that its latest version will support additional plugins. These plugins can help Baidu's AI tackle more specialized tasks, like summarizing lengthy texts and providing more precise answers.

In March, Baidu became Baidu was the first major Chinese tech organization to unveil an AI product, Ernie Bot, aimed to rival ChatGPT in the domain of AI language models. Other notable Chinese firms, such as Alibaba, Tencent, and SenseTime, have also launched their own AI initiatives.

In May, Baidu announced Baidu Ventures has initiated a $145 million venture capital fund to back AI-centric startups within China. The goal of Baidu Ventures is to establish itself as a frontrunner in this AI-dominated era, having already invested in more than 100 tech businesses. Baidu is also organizing a contest inviting developers to create applications that utilize its ERNIE language model.

Read more:

Tags:

Disclaimer

In line with the Trust Project guidelines It’s important to clarify that the information shared on this page is not designed to serve as legal, tax, investment, financial, or any other kind of counsel. Always invest only what you can afford to lose, and seek independent financial advice when in doubt. We recommend checking the terms and conditions along with the help and support pages offered by the issuer or advertiser. MetaversePost is dedicated to providing accurate and impartial reporting; however, market conditions can shift unexpectedly.