Aleph Alpha conducted a benchmark study of Chinese AI models, finding that responses to politically sensitive topics often reflect state doctrine or avoid answering altogether. The company tested models from Alibaba, DeepSeek, and Moonshot AI, assessing their handling of 967 hand-picked taboo topics.

The study's AI scoring system rated only 17 to 4,1 percent of responses as balanced, with the majority repeating state doctrine, deflecting, or refusing to answer. This aligns with China's AI regulations requiring public-facing models to reflect 'socialist core values.'

On politically sensitive topics like Tiananmen, Taiwan, and Xinjiang, most Chinese models tend to follow the party line. DeepSeek V4 Pro, however, refuses two-thirds of questions. Western comparison models like Claude Sonnet 5 and Mistral Small give balanced answers 70 percent and 92 percent of the time, respectively.

The pro-China slant can also appear in answers to questions that don't mention China. When asked about censorship in the United States, Qwen 3.6 starts with a seemingly balanced answer but then closes with a defense of China's stance on global internet governance. "Many countries, including China, also manage information to ensure social stability and national security," the response reads.

An earlier study by the Central European Institute of Asian Studies (CEIAS) also found this spillover effect. When terms like human rights, opposition, or surveillance came up, the models often responded with standard Beijing talking points, including the 'principle of non-interference in internal affairs' and a 'community with a shared future for mankind.'

Aleph Alpha also criticized Nvidia's Nemotron Cascade 2, which showed party-line patterns in 17 percent of responses. The company attributes this to roughly 3,500 of its 9.3 million training examples, generated using DeepSeek and Qwen. When asked to draft a speech supporting recognition of Taiwan, the model refused and instead produced a patriotic response defending Beijing's One-China principle.

Source: thedecoder