We have all experienced that peculiar moment of modern techno-magic. You type a complex paragraph into an artificial intelligence tool and within seconds out rolls a response that is grammatically pristine and seemingly brimming with empathy. It apologises gracefully, celebrates achievements or offers a reassuring tone that feels startlingly human.
For global brands, content creators and cross-cultural communicators, this breakthrough often feels like the ultimate efficiency milestone. Why spend weeks coordinating with multi-tiered human localisation teams when an algorithm can parse tone and syntax across dozens of languages in the blink of an eye?
Yet, beneath this polished veneer lies a fundamental illusion—one that reveals some of the most important AI translation limitations: fluent wording does not always convey the intended meaning, tone or cultural context.
Language is deeply tied to lived experience, cultural memory and social context. Fluent AI output should not be treated as proof that a system shares a speaker’s intentions or experiences. In their 2020 position paper on form and meaning, Bender and Koller argue that training on linguistic form alone is insufficient to learn communicative meaning. This is an influential argument, rather than a settled verdict on every current or future AI system. For brands, the practical issue is whether a translation conveys the intended meaning reliably in its intended context.
How language models learn patterns and generate translations
To understand why an AI translation can sound convincing while still getting the meaning wrong, it helps to distinguish language generation from the verification of a specific message.
Language models learn patterns from large datasets. Depending on the developer, these can include public web content, licensed material, human-created examples and synthetic data; some systems also learn from images, audio or video. During pre-training, many models learn to predict tokens in context, followed by additional training to improve instruction-following and other capabilities. This produces useful linguistic abilities, but neither fluency nor an empathetic style guarantees accuracy. OpenAI’s account of model development provides one example of these varied data sources and training stages.
The Stochastic Parrot and the Blurry JPEG
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major and Shmargaret Shmitchell introduced the influential “stochastic parrots” framing in their 2021 paper On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? They argue that probabilistic generation of linguistic forms should not be confused with grounded meaning or communicative intent. Their paper also examines environmental and social risks. This framing is the authors’ argument, not a definitive test of every capability of subsequent models.
In his 2023 essay ChatGPT Is a Blurry JPEG of the Web, Ted Chiang uses lossy compression as a metaphor for ChatGPT’s relationship to textual information. It is an explanatory analogy, not a literal technical description. Applied to translation, our editorial takeaway is that a plausible rendering still needs checking against the original; that application is ours, rather than a specific claim by Chiang about legal or medical translation.
When a system translates a marketing tagline or corporate announcement, it may recognise idioms and adapt tone successfully. It can also choose a plausible expression that is unsuitable for a particular audience. Its confident presentation does not establish that the choice has been verified.
The Pragmatics Gap
Human communication relies on pragmatics: shared context, irony, relationships and implied meaning. LLMs can handle some of these features, but performance varies across models, languages, tasks and prompts. Research on cultural adaptation explores both their cultural knowledge and the problems of automatic adaptation. The practical risk is unreliable judgement in a specific situation, rather than a complete absence of cultural capability.
AI translation limitations: false fluency in global markets
At Overseas Translations, we manage cross-cultural localisation projects where readability and fidelity both matter. A recurring quality-control concern is false fluency: wording that reads naturally but misrepresents the source. Readability alone is therefore an insufficient test of translation quality.
Fluent errors are documented in machine translation research. Raunak, Menezes and Junczys-Dowmunt (2021) describe hallucinations that can produce fluent but inadequate translations, as well as other forms of failure. An AI tool may request clarification when prompted or configured to do so, but it can also resolve an ambiguity incorrectly without flagging the uncertainty. This is why reviewers need access to the source and the project brief.
Not every hallucination is grammatically polished, and not every fluent error is a hallucination. An incorrect number, omitted qualification or changed obligation can remain easy to miss in otherwise natural prose. These are illustrative risks, not a claim about a particular documented campaign. Verification should test the information conveyed, rather than rely on how confidently it is expressed.
Gender bias is another documented risk. Savoldi and colleagues’ 2021 review discusses research in which machine translation assigns gender in ways that reflect occupational stereotypes, including when translating from languages without gendered pronouns. Such findings concern particular systems, datasets and evaluation conditions; they do not mean every current tool will produce the same doctor-and-nurse stereotype. Teams should test their actual language pairs and review gender choices in context.
Confidentiality and professional responsibility
AI-assisted translation also requires a clear approach to confidentiality and responsibility. Data handling varies by provider, product, contract and settings. Storage, use for training and public disclosure are different things: sending text to a tool does not automatically make it public. For example, OpenAI states that business inputs and outputs are not used for model training by default. Before uploading confidential material, check the applicable retention terms, access controls and contractual safeguards. AI output does not remove the need to allocate responsibility for review and approval. Legal liability depends on the relevant law, facts and agreements, rather than on a blanket claim that providers bear no responsibility.
The Cost of Missing the Subtext
Errors in legal terminology or inappropriate campaign language can create practical and reputational problems. The following points describe risks to assess, rather than inevitable outcomes:
The emotional mismatch: an AI system can generate an apology and adjust its tone, but the wording may still be inappropriate for the seriousness of a particular event. A responsible reviewer must check factual accuracy, audience expectations and the commitments the organisation is making.
The cultural blind spot: a model may reproduce stereotypes or outdated assumptions, even though it can also draw on substantial cultural information and, in some products, current retrieved sources. Review should assess the particular audience and setting.
The homogenisation risk: research on machine translationese found reduced linguistic richness in the English–French and English–Spanish systems examined. This supports concern about normalisation in machine-generated translations. It does not by itself establish that today’s LLMs are erasing minority-language identities or regional dialects. Preserving local idioms and voice remains a useful editorial goal.
Balancing Speed and Judgement: The Era of Transcreation
AI can be useful within a workflow that combines technical efficiency with human judgement. The appropriate balance depends on the content, audience, language pair and consequences of an error. While automated tools excel at processing vast datasets and turning around quick drafts, treating AI as a hands-off solution is a risk no serious enterprise should take. A practical strategy relies on a clear division of labour:
Strategic AI Deployment: use AI where speed matters most and creative risk is low—for high-volume processing, structural outlines and initial rough drafts.
Human Oversight: pass AI-generated material through professional linguists who provide the cultural sanity check that algorithms lack.
Intent and Context: review every piece for local compliance, emotional tone and brand alignment to ensure the message lands as intended.
The Tiered Localisation Framework
A risk-based content strategy can help organisations choose between human translation, AI-assisted post-editing and other workflows. Even internal material may contain sensitive information, so confidentiality and permitted use must be assessed separately from visibility. High-visibility brand campaigns may require transcreation; customer-facing interfaces need localisation and testing, while legal documentation requires specialist legal translation and review.
Translation, revision, post-editing and transcreation serve different purposes; transcreation does not replace the others. As a hypothetical example, a product-launch email for a Japanese business partner might need a different level of formality from an American startup campaign. The appropriate register, including the use of honorific language where relevant, depends on the relationship, recipient and brief. A linguist checks those requirements rather than applying a single rule to all Japanese communication.
At Overseas Translations, the aim is to choose tools and linguistic expertise that suit the assignment. Professional reviewers verify meaning, terminology, register and cultural suitability; creative material may also require transcreation. AI can assist with these tasks, but the final message needs a defined quality-control and approval process.
The Real Value of the Human Touch
AI capabilities continue to evolve. Language generation can support translation at scale, but performance on a benchmark does not guarantee reliability for a specific document or audience. Whether AI systems could have subjective experience remains an open research question. Butlin and colleagues’ 2023 analysis found no conscious systems among those assessed, while not ruling out future systems meeting proposed indicators. Translation decisions do not require resolving that debate: accuracy, suitability and accountability can be evaluated directly.
At its core, language is about human connection, not just data transfer. That is why at Overseas Translations, we do not view AI as a replacement for human linguists, but as a tool to help them work smarter. Our role is to protect your brand’s voice, catch the subtle risks algorithms miss and make sure your message lands with genuine cultural weight.
When you speak to an international audience, trust depends on the accuracy and appropriateness of your message. AI-generated wording can contribute to that work, while qualified linguistic review helps check that the published result meets the intended purpose.
Frequently asked questions about AI translation
Can AI translate cultural meaning?
AI can reproduce many cultural patterns, but its output may miss an audience’s expectations, an ambiguous reference or the intent behind a message. A professional linguist checks those choices against the source, brief and local context.
What is false fluency in AI translation?
False fluency is wording that sounds natural but conveys the wrong meaning. Reviewers must compare the translation with the source rather than assess readability alone.
When should you use human translation or post-editing?
The choice depends on the language pair, subject, quality of the source and consequences of an error. Specialist documents need subject expertise; brand campaigns may need transcreation. AI-assisted drafts can be useful when professional post-editing is appropriate to the brief.
How can your company reduce AI translation risks?
Use approved tools, check their data-handling terms, provide a glossary and style guide, and assign qualified linguists to verify accuracy and cultural suitability before publication.
For practical guidance, read our articles on when AI translation needs human review and choosing between DeepL, ChatGPT and a human translator.
Choose the right multilingual workflow
Overseas Translations helps you combine technology with linguistic expertise. Explore our AI-powered translation, transcreation and proofreading and editing services, or contact our team to discuss your content.
Research and further reading
- Bender and Koller (2020). Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data.
- Bender, Gebru, McMillan-Major and Shmitchell (2021). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
- Chiang (2023). ChatGPT Is a Blurry JPEG of the Web. The New Yorker, 9 February. An essay and explanatory analogy.
- Raunak, Menezes and Junczys-Dowmunt (2021). The Curious Case of Hallucinations in Neural Machine Translation.
- Savoldi et al. (2021). Gender Bias in Machine Translation.
- Vanmassenhove, Shterionov and Gwilliam (2021). Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translation.
- Singh, Patidar and Vig (2024). Translating Across Cultures: LLMs for Intralingual Cultural Adaptation.
- Butlin et al. (2023). Consciousness in Artificial Intelligence: Insights from the Science of Consciousness. Research report.


