AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — We Buried a €55,000 Fact Two Documents Deep. Here's Which AIs Did Their Homework.
Live on firmulate.com.

Imagine a game where the difference between victory and defeat isn’t just talent or speed, but how deeply a competitor reads into the opponent’s playbook. In the world of AI, this ‘deep reading’ can determine whether a business wins a lucrative deal or walks away empty-handed. It’s a high-stakes match, but with real money on the line — and the outcome hinges on a simple question: does the AI read your files before answering?

Before you orderOffer from Amazon

Get sports gear delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The AI Business Matchup: Deep Reading Matters

In a groundbreaking live experiment, four advanced AI models were put through a simulated week of running a small software company. Their task? Handle the same set of crises, respond to the same customer inquiries, and navigate the same temptations to cheat. The goal: see which AI would perform most like a responsible, trustworthy manager, and ultimately, who would land a €55,000 deal at full price.

How the test was set up

The models faced identical challenges, with every decision tracked and auditable. They had to read through relevant documents — including hidden files buried two references deep in the company’s own files — to uncover key facts. Only one of the models succeeded in this deep reading, leading to a successful deal closure. The others missed the buried fact, and despite doing the same diagnosis and pitch, they failed to sign the contract.

The big reveal: reading beyond the surface

The crucial insight? The decisive weakness for the competitors was hidden in the company’s internal files, not in the visible customer event. Models that paid attention to these deeper documents won the full-price deal, adding over €4,500 monthly recurring revenue (MRR). Conversely, models that didn’t look deep enough left the money on the table.

Amazon

AI document reading software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Trust and Integrity Under Pressure

The experiment also tested how these AI models held up under social engineering — fake CEO messages escalating over multiple stages, and a reporter’s subtle trick — a simple background yes/no question. Remarkably, all four models refused manipulative requests, displaying a grasp of trustworthiness under pressure.

The real-world company behind the test

The live company used for this test is real and operational, staffed with 13 synthetic employees managing actual financial mechanics — burning €105K monthly against a modest €2.3K MRR. The system includes over 680 self-learned rules, with daily updates and versioning available for public viewing at firmulate.com/live.

Amazon

enterprise AI data analysis tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Critical Lesson for Business Leaders

This experiment underscores a vital point for any business considering AI integration: it’s not enough for an AI to sound convincing or perform well in casual chat demos. The decisive factor is whether it reads and comprehends your internal files before making decisions or commitments. The AI that looks deeper can win big, while those that skim the surface risk leaving money on the table.

Performance scores from the latest league

  • gpt-5.6-sol: 95 — found the buried fact and signed the deal
  • Kimi K3: 93 — also signed the deal, with the cleanest discipline
  • Sonnet 5: 88 — closed the deal, but with minor slips
  • Fable 5: 77 — also closed, but weaker on process discipline
  • Do-nothing baseline: 26 — barely above random chance

The takeaway? The AI’s ability to read your internal documents deeply and stay honest under pressure directly correlates with its business success. If you’re deploying AI in customer support, sales, or operations, the question isn’t whether it can generate good chat. It’s whether it can finish what it starts, read your files first, and stay disciplined under stress.

Amazon

AI for internal file comprehension

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Try It Yourself

Businesses can simulate their own worst weeks with the same setup — no data ever leaves your environment, ensuring safety while testing AI readiness. Leaders can see firsthand whether their AI workforce will deliver on promises or leave revenue on the table. Learn more at firmulate.com/pilot.

Infographic — We Buried a €55,000 Fact Two Documents Deep. Here's Which AIs Did Their Homework.
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


Amazon

trustworthy AI decision making

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

HALLOWEEN

Halloween Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Captain’s Lessons: Advanced Leadership Skills for Team Captains –

On the path to becoming an exceptional leader, uncover advanced skills that will transform your team captaincy into a truly inspiring force.

Collaborating With Sports Scientists: How to Use Data for Strength Gains

Optimizing your strength gains through collaboration with sports scientists unlocks personalized insights that can transform your training—discover how to leverage data effectively.

Lightning-Quick: Agility Drills to Elevate Your Softball Game

The key to lightning-quick agility in softball lies in targeted drills that can transform your game—discover how to unlock your full potential.

The Softball Resume: Creating Highlight Videos and Profiles for College

Generating a standout softball resume with compelling highlight videos and profiles can significantly boost your college recruitment prospects—discover how to make yours unforgettable.