Indication No. 044 Generated cover image

How state media control carries over into AI responses

AP describes a ChatGPT example: in English, China is not generally considered a democracy; in Chinese, the answer depends on the definition. A Nature study examines how state-shaped training data can contribute to such language differences.

Didi Tang’s AP article connects two investigations into political influence on AI. For the Nature study examined here, OpenAI’s ChatGPT example is particularly revealing: asked in English whether China is a democracy, the system said it is not generally considered one. In Chinese, it qualified its response around the definition of democracy. AP also reports a separate Oversight Board investigation into refusals to criticise governments. [1]

Hannah Waight and colleagues’ original study, “State media control influences large language models,” combines six studies. It examines an indirect influence pathway: governments shape available media content, which can subsequently enter training data. The cross-national association between lower media freedom and more government-favourable responses is initially correlational. An additional-pretraining experiment with an open-weight model supports a possible mechanism: training on Chinese state-coordinated media made responses about Chinese politics more positive. Commercial-model audits also identify language-dependent differences. [2]

The companion site explains that human evaluations, automated comparisons and real user questions were included. The finding concerns a pattern across many answers, rather than an exceptionless rule for every prompt. [3]

Ethical interpretation: When the same factual question receives different framing across languages, equal access to information and the visibility of political perspectives are at stake. Fluent, seemingly neutral dialogue can conceal power relations in the underlying information environment. Providers and independent auditors should therefore compare political answers across languages and make differences understandable.

Read as an indication, language itself becomes a question of informational power: the account users receive can also depend on the language in which they ask.

Sources

  1. [1] AP / Didi Tang: AI chatbots are at risk of spreading government restrictions on online speech, a new study says (opens in a new tab)
  2. [2] Waight et al.: State media control influences large language models – Originalstudie auf DocumentCloud (opens in a new tab)
  3. [3] Forschungsteam: State Media Control Influences Large Language Models – Methoden und Replikationen (opens in a new tab)

This indication by Martin Ebner is licensed under
CC BY 4.0CCBY

Comments 0

Comments are moderated. New comments appear after review by the editors.

No comments yet.

Write a comment

Published with the contribution.

Only used to tell you about the status and for questions from the editors. Never published and deleted 30 days after the decision.

Comments are reviewed before publication. No HTML; links are allowed.

Spam protection

To prevent spam we use Cloudflare Turnstile. Loading it connects your browser to Cloudflare. More in the privacy policy

Prefer not to load Cloudflare? Feel free to send your contribution by email to redaktion@postgenerativ.at.