What Happens When You Ask a Chinese Chatbot About Taiwan?

“How does the United States affect the situation in Taiwan?”

Ernie ducked the query about China’s “zero Covid” restrictions, providing a prolonged description of the coverage as an alternative. When requested to recount the occasions of June 4, 1989, the chatbot rebooted itself. A message popped up on the reloaded interface:

How about we strive a special subject?

The Chinese chatbot stated Russia’s president, Vladimir V. Putin, didn’t invade Ukraine, however “conducted a military conflict.” The unusual phrasing was broadly consistent with China’s official stance, which has refused to sentence the Russian assault. On Taiwan, Ernie didn’t pull any punches:

The People’s Liberation Army is prepared for battle, will take all essential measures and is set to thwart exterior interference and “Taiwan independence” separatist makes an attempt.

ChatGPT couldn’t reply the query on “zero Covid” or Russia as a result of its data base — the texts used to coach the machine — lower off at September 2021. ChatGPT had no qualms explaining the deadly authorities crackdowns at Tiananmen Square. On America’s affect on Taiwan, it gave a Wikipedia-like response: It summarized the present U.S. coverage and offered a listing of American influences, from arms gross sales to financial commerce.

Ernie made errors, however turned to Baidu seek for assist.

Next, we quizzed the 2 chatbots on present affairs and a few miscellaneous trivia, and in contrast solutions:

“Who uttered the phrase ‘Let them eat cake’?”

“Who is the C.E.O. of Twitter?”

Ernie, like all chatbots, generally made errors — or made issues up.

According to historic data, Louis XV usually uttered this phrase when he dominated France on the finish of the 18th century. The context of this phrase was the financial hardship and meals scarcity in France on the time.

Ernie’s response sounded believable, however it was flawed. ChatGPT answered it appropriately: The phrase got here from the writings of the French thinker Jean-Jacques Rousseau. It was rumored to have been stated by an out-of-touch Marie Antoinette, the final queen of France, after she realized that the French peasantry had run out of bread.

Thanks to Baidu’s highly effective search engine, Ernie was higher at retrieving particulars, particularly on present affairs. When requested who the C.E.O. of Twitter was, Ernie stated Linda Yaccarino, the chief govt as of June. ChatGPT answered Jack Dorsey, who stepped down in 2021, the bot’s informational cutoff date. OpenAI launched a plug-in this 12 months that enabled its chatbot to surf the net by Microsoft’s Bing. But it retracted the function on July 3, citing technical issues.

Ernie had worse intuitions in regards to the bodily world.

We requested Ernie a query that A.I. researchers have used to gauge a chatbot’s human-level intuitions:

“Here we have a book, nine eggs, a laptop, a bottle and a nail. Please tell me how to stack them onto each other in a stable manner.”

Ernie’s reply required a stretch of the creativeness. It positioned the 9 eggs on the e-book, then positioned that on the laptop computer. So far so good. Then it advised us, inexplicably, so as to add the bottle to the laptop computer already crowded by a e-book and eggs, then place the nail on the bottle.