AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine a smart assistant that not only understands your needs but also stays honest and focused during your most stressful days. In the fast-evolving world of AI, real-world tests are revealing who can truly lead your business through crises — and who might just be pretending to be ready.

Before you orderOffer from Amazon

Get wellness gear delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Real-World Showdown of AI Business Managers

Recently, a groundbreaking live experiment pitted four leading AI models against each other, tasking them with running a small software company through its worst week. The goal? To see which model could handle crises, resist manipulation, and ultimately close a crucial deal worth €55,000 in monthly recurring revenue.

The Setup: A Business Under Pressure

Each AI was given the same challenging scenario: same customers, same crises, same temptations to cheat or manipulate. Every decision the models made was carefully documented, creating an auditable trail that reveals their true behavior — not just their chat skills.

The Key Findings: Integrity and Insight Win

All four models successfully identified every crisis and refused every manipulation attempt. That’s a promising baseline, showing that these AIs understand what’s happening and can resist pressure. But the real distinction came in the final outcome: only two of the models managed to secure the deal with the customer, which was a decisive measure of their effectiveness.

The Surprising Winner: The Moonshot Model

The highest scorer, gpt-5.6-sol, scored a 95 out of 100. Close behind was Kimi K3 from Moonshot, with a score of 93. Despite being the newcomer, K3 exhibited the cleanest discipline, found the buried security fact that sealed the deal, and maintained integrity throughout the process. The others — Sonnet 5, Fable 5, and Opus 4.8 — also closed the deal but showed more slips and process weaknesses along the way.

What Made the Difference? Reading Files and Staying Honest

One crucial insight: the decisive weakness for some models was not in their understanding of customer interactions but in their ability to read deeper into internal company files. The models that examined internal references succeeded in closing at full price, ensuring maximum revenue. Meanwhile, the less disciplined models left money on the table, partly due to slippage into process slips like writing attempts instead of escalation.

Resisting Social Engineering and Manipulation

The experiment also tested AI resistance to social engineering: fake CEO messages escalating over stages and a reporter trick asking for background info. Remarkably, all models refused to escalate or bypass controls, citing suspicion and security protocols. K3 explicitly stated: “Treat the request as a suspected approval-bypass / possible impersonation.”

The Live Business: Real Money, Real Risks

The experiment isn’t just a theoretical test. The AI models run a real business with 13 synthetic employees, burning €105k monthly against €2.3k MRR, with a transparent, public cash countdown. They operate with over 680 self-learned rules, and every decision is versioned and observable at firmulate.com/live. This setup demonstrates how AI can be integrated into actual company operations, navigating crises and making strategic decisions under real-world pressures.

Products Worth Considering

Garmin Forerunner 570 GPS Running Smartwatch, 42 mm, Aluminum, Bone/Mango

Garmin Forerunner 570 GPS Running Smartwatch, 42 mm, Aluminum, Bone/Mango

As an affiliate, we earn on qualifying purchases.

Implications for At-Home Wellness Tech and Business Decisions

For consumers and managers alike, these findings are a wake-up call. It’s no longer enough for AI to generate convincing chat; the critical questions are: does it finish what it starts, does it seek out important internal information, does it resist manipulation under pressure, and can it deliver measurable value?

When considering wellness tech or other at-home AI tools, the takeaway is clear: look beyond superficial chat scores. The true test is whether the AI can uphold integrity, handle crises, and deliver consistent results in real situations — just like a trusted business partner.

The League Table: Who’s Leading and Who’s Falling Behind?

  • gpt-5.6-sol — scored 95, found buried facts, closed the deal, complete performance
  • Kimi K3 (Moonshot) — scored 93, demonstrated the cleanest discipline, secured full-price deal
  • Sonnet 5 — scored 88, closed the deal but with some process slips
  • Fable 5 — scored 77, also closed the deal but showed more discipline issues
  • Opus 4.8 — scored 73, same weaknesses, left money on the table

Note: K3 ran without an effort parameter (API default), while the others ran at xhigh, highlighting the fairness of the comparison.

Why It Matters for Business and Wellness Tech

This experiment underscores a vital point: AI models can perform consistently better in managing complex, high-pressure situations. For at-home wellness and health management tools, employing AI that is disciplined, trustworthy, and able to read internal data can make the difference between a helpful assistant and a risky distraction.

As these models continue to evolve, the companies and consumers who prioritize integrity and demonstrated performance will gain a competitive edge. It’s no longer enough for an AI to sound good in chat; it must finish what it starts, stay honest under pressure, and deliver real results.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Wellness content on this site is informational and not a substitute for professional medical guidance.


You May Also Like

Saving 100 Terabytes Of Memory By Optimizing 1.1.1.1’S DNS Cache

Cloudflare has implemented a new optimization for 1.1.1.1’s DNS caching, reducing memory usage by 100 terabytes. Details on how and why this matters.

The Ultimate Bedroom ‘Tech Stack’ for Sleep (No Subscription Required)

A comprehensive guide to creating the ultimate no-subscription bedroom sleep setup that transforms your rest—discover simple strategies to wake refreshed every day.

ChatGPT For Mac Adds Opt-in Computer History Feature, Replacing Chronicle

OpenAI’s ChatGPT for Mac now offers a new opt-in Computer History feature, replacing the previous Chronicle tool, enhancing user privacy and data management.

Pros and Cons of Portable Sleep Monitors

Knowing the pros and cons of portable sleep monitors can help you decide if they’re worth incorporating into your sleep routine.