AIreliable sources

Reliable sources and AI: how do you separate fact from fiction?

AI is changing our relationship with truth. See how algorithms judge reliable sources and how to avoid the traps.

Mehdi B.

Co-founder · SEO & digital strategy

Reliable sources and AI: how do you separate fact from fiction?

You probably use ChatGPT or Google Gemini daily to write emails, summarise documents or look up quick information. It has become a reflex for many of us. But have you ever asked yourself how these tools decide what is true and what is false?

In the world of before, a reliable source was a book published by a recognised house, an article signed by a journalist or a peer-reviewed study. Today, the definition is changing radically. Artificial intelligence does not “read” sources the way we do; it ingests billions of data points and calculates probabilities.

This paradigm shift upends our relationship with truth and information. In this article, we will explore how AI engines are redefining reliability and how you can navigate this new ecosystem without falling into its traps.

What was a reliable source (before AI)?

Historically, assessing the credibility of a piece of information rested on tangible, human criteria. These methods were taught at university or in journalism schools. It was a solid framework for filtering out the noise.

Here are the traditional pillars of reliability:

  1. Authority: who is the author? Do they have the qualifications or the experience?
  2. Objectivity: is the information neutral or does it serve a particular agenda?
  3. Accuracy: are the facts verifiable and sourced?
  4. Currency: is the information up to date?

These criteria show their limits when faced with AI, however. An algorithm does not care about the author’s qualifications. It does not understand the concept of reputation the way a human does. For an AI, a very popular Reddit post can sometimes carry as much statistical weight as a rarely cited academic article.

Comparison: human criteria vs algorithmic criteria

Criterion Traditional approach (human) AI approach (algorithmic)
Validity Based on the reputation of the author/publisher Based on the recurrence of patterns in the data
Bias Critical judgement and context Statistical biases inherited from training data
Trust Institutional (Le Monde, EPFL, etc.) Probabilistic (the most likely next word)
Context Cultural and nuanced understanding Semantic analysis without real consciousness

How do AI engines determine reliability?

Artificial intelligence is not looking for “truth” in the philosophical sense. It is looking for statistical coherence. When a language model (LLM) generates an answer, it predicts the most plausible next words based on its training.

Data analysis and recurrence

Imagine that AI has read the whole internet. If 90% of texts associate “sky” with “blue”, the AI will conclude that this is reliable information. For an AI, reliability is often a question of volume and repetition. If a piece of false information is repeated often enough on high-traffic sites, it risks being ingested as a truth.

Human validation (RLHF)

Fortunately, this is not the Wild West. Model creators use techniques such as reinforcement learning from human feedback (RLHF). Humans rate the AI’s answers to teach it to favour quality sources and avoid toxic content. It is an essential safeguard, but it is not foolproof.

The main challenges of AI-based evaluation

AI is a remarkable tool, but it raises complex problems when it comes to reliability. The first is the “black box” effect. We do not always know which precise sources were used to generate a given answer.

Algorithmic bias

Algorithms are not neutral. They reflect the data they were trained on. If that data contains mostly Western or English-speaking viewpoints, the AI will tend to treat those perspectives as more “reliable” or standard, marginalising other world views.

Hallucination and verification

This is the best-known problem: AI can invent facts with absolute confidence. It can cite sources that do not exist or attribute quotes to the wrong people. For the user, that makes verification tedious. You can no longer blindly trust generated text, even if it looks professional.

Chart: public trust in AI

The chart below illustrates how the reliability of AI-generated content is perceived, according to a recent study (data modelled for the example).

Information sector Trust in human content Trust in AI content
Health & Medicine 85% 40%
Finance & Economy 78% 55%
General news 65% 35%
Code & Technical 70% 85%

What we see is that while AI is judged very reliable for technical tasks (code), mistrust remains for sensitive subjects such as health.

TO READ: How do you structure a site to be quoted correctly by AI?

The concrete impact on our society

This redefinition of what a reliable source is has direct consequences for our professional and personal lives.

Education and research

Students use AI for their coursework. The risk is seeing a generation emerge that no longer knows how to find information at the primary source, and settles instead for the summary digested by an algorithm. Swiss and European universities need to adapt their curricula to teach AI criticism rather than banning it.

Journalism and media

The media are under pressure. If Google offers a direct AI-generated answer (SGE), the user no longer clicks on the newspaper's link. That raises an economic question, but also a democratic one: if the primary source disappears for lack of revenue, what will the AI train on in the future?

Best practices for assessing sources in the age of AI

So how do you cope? You cannot stop progress, but you can adapt the way you work. Here is a pragmatic approach to using AI without being fooled by it.

1. The triangulation rule

Never rely on a single AI answer for a critical decision. Cross-check the information. If ChatGPT gives you a key figure for your marketing strategy, ask it for its source, then verify it on Google or in an official report.

2. Understanding the tool’s limits

Use AI for what it does best: summarising, rephrasing, coding. Be far more cautious when it comes to precise historical facts, medical data or very recent events (on which it has little perspective).

3. Consulting human experts

Human intuition and experience remain irreplaceable for putting information in context. AI can tell you what happened, but an expert can better explainwhy it matters for your specific business.

Towards a new digital hygiene

The notion of a reliable source has not disappeared, it has become more complex. We are moving from an era of institutional trust to an era of continuous verification. AI is a powerful assistant, but it must not become your only editor-in-chief.

For entrepreneurs and decision-makers, the stakes are high: use the power of AI to save time, while keeping a sharp critical mind to avoid strategic mistakes. Next time you copy and paste an AI answer, take three seconds to ask yourself: “If this were wrong, what would the consequences be?”

Sources and recommended reading

  1. European Commission: Ethics guidelines on AI – to understand the regulatory framework for trust in AI.
  2. OpenAI Research: GPT-4 System Card – technical detail on the limits and safety of the models.
  3. EPFL (Swiss Federal Institute of Technology Lausanne): Center for Digital Trust – Research on digital trust and cybersecurity.
  4. UNESCO: Artificial intelligence in education: an analysis of the impact on learning and on the reliability of knowledge.
artificial intelligencecopywriting
Mehdi B.
About the authorMehdi B.

Co-founder of Smart Impact. Hooked on the web from the start, he launched his first project in 2006: an online music magazine still running today. With close to 20 years of SEO experience, a Swiss federal diploma in marketing and a solid geek streak, he turns clients' ideas, sometimes hazy ones, into concrete digital projects with his team.

LinkedIn
Further reading
Aa TYPO
Font Preview

Try the typographic combinations live. Click to apply.

Active
Outfit / Outfit
Premium consulting (alt. Söhne)
Premium Editorial
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Playfair Bold · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: DM Serif Display · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Merriweather Black · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Cormorant Bold · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Lora Bold · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Playfair Bold · Body: Source Sans Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Georgia Bold · Body: Outfit Regular
Premium Consulting
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: DM Sans Bold · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Jakarta ExtraBold · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Outfit Bold · Body: Outfit Regular
Understated & Effective
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Inter Bold · Body: Outfit Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Source Sans Bold · Body: Source Sans Regular
The digital patchwork
From strategy to execution, every service is interconnected.
Headings: Libre Franklin Bold · Body: Outfit Regular
Accent colour
Orange
#E8731A
Royal Blue
#2563EB
Emerald
#059669
Purple
#7C3AED
Red
#DC2626
Cyan
#0891B2
Amber
#D97706
Pink
#DB2777
Deep Emerald
#3D7F6E
Emerald Green
#377E6E
Midnight Blue
#1E3A5F
Burgundy
#7A1F3D
Antique Gold
#A67C00
Terracotta
#B85C38
Petrol Blue
#1A5C6B
Olive
#6B7A3D
Plum
#5B2C6F
Steel
#3E6B8A
Coral
#D06040
Slate
#546E7A
Active colour
Orange (current)